-- Logs begin at Mon 2022-07-04 03:08:38 UTC, end at Mon 2022-07-04 04:38:05 UTC. -- Jul 04 04:06:09.891946 dv-cinder-742162-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 04 04:06:09.902034 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 04 04:06:09.903615 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 4 04:06:09 2022] *** Jul 04 04:06:09.903615 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 04 04:06:09.903615 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 04 04:06:09.903615 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: nodename: dv-cinder-742162-5-iscsi Jul 04 04:06:09.903615 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: machine: x86_64 Jul 04 04:06:09.903615 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: clock source: unix Jul 04 04:06:09.903615 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: pcre jit disabled Jul 04 04:06:09.903615 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: detected number of CPU cores: 4 Jul 04 04:06:09.903615 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: current working directory: / Jul 04 04:06:09.903615 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: detected binary path: /usr/bin/uwsgi-core Jul 04 04:06:09.904276 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: your processes number limit is 47680 Jul 04 04:06:09.904276 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: your memory page size is 4096 bytes Jul 04 04:06:09.904276 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: detected max file descriptor number: 2048 Jul 04 04:06:09.904276 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: lock engine: pthread robust mutexes Jul 04 04:06:09.904276 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: thunder lock: enabled Jul 04 04:06:09.904276 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 04 04:06:09.904276 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 04 04:06:09.947015 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: Python main interpreter initialized at 0x5599bcbaa9c0 Jul 04 04:06:09.947015 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: python threads support enabled Jul 04 04:06:09.947015 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: your server socket listen backlog is limited to 100 connections Jul 04 04:06:09.947015 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: your mercy for graceful operations on workers is 90 seconds Jul 04 04:06:09.947365 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: mapped 403077 bytes (393 KB) for 2 cores Jul 04 04:06:09.947428 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: *** Operational MODE: preforking *** Jul 04 04:06:09.947671 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: *** uWSGI is running in multiple interpreter mode *** Jul 04 04:06:09.947671 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: spawned uWSGI master process (pid: 103336) Jul 04 04:06:09.947871 dv-cinder-742162-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 04 04:06:09.951092 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: spawned uWSGI worker 1 (pid: 103337, cores: 1) Jul 04 04:06:09.951092 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: spawned uWSGI worker 2 (pid: 103338, cores: 1) Jul 04 04:06:09.951092 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 04 04:06:10.598879 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 04:06:10.599508 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 04:06:11.701943 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 04:06:11.701943 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: from cryptography.utils import int_from_bytes Jul 04 04:06:11.702631 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 04:06:11.702631 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: from cryptography.utils import int_from_bytes Jul 04 04:06:11.703013 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 04:06:11.703013 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: from cryptography.utils import int_from_bytes Jul 04 04:06:11.703125 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 04:06:11.703125 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: from cryptography.utils import int_from_bytes Jul 04 04:06:14.145335 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 04:06:14.145961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 04:06:14.146052 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 04:06:14.146471 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 04:06:14.146685 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 04:06:14.147101 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.147417 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.147732 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.148046 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.148354 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.148660 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.149025 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.149330 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.149659 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.149916 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.150224 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.150570 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-742162-5-iscsi {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.150724 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 04:06:14.151111 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.151201 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 04:06:14.151279 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.151450 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.151536 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 04:06:14.151761 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.151847 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 04:06:14.152059 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.152145 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 04:06:14.152374 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.152471 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.152675 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.152767 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.153038 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.153177 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.153372 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.153599 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.153736 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.153900 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.154012 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.154204 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.154422 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.154571 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.154702 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.154887 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.155024 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.155124 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.155206 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.155435 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.155563 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.155753 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-742162-5-iscsi {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.155846 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.156067 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.156159 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.156366 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.156450 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.156667 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.156760 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-742162-5-iscsi {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.156977 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.157086 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.157279 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.157376 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.157591 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.157685 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.157890 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.158030 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.158349 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.158485 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.158668 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.158769 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.158982 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.159070 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.159284 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.159388 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.159587 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.159688 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.159903 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.159996 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.160203 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.160300 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.160515 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.160700 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.160813 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.160908 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.161107 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.161200 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.161406 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.161493 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.161706 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.161799 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-742162-5-iscsi {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.162015 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.162103 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.162314 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.162420 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.162637 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.162738 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.162882 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.163071 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.163171 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.163376 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.163484 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.163679 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.163796 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.163990 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.164110 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.164343 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.164430 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.164613 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.164699 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.164922 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.165010 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.165242 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.165421 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.165530 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.165615 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.165830 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.165919 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.166120 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.166216 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.166438 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.166540 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.166739 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.166836 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.167037 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.167122 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.167334 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.167457 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.167628 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.167731 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.167870 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.167966 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.168173 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.168278 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.168483 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.168578 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.168794 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.168940 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.169091 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.169245 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.169383 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.169519 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.169660 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.169803 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.169951 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.170089 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.170231 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.170398 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.170544 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.170692 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.170837 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.170977 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.171111 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.171253 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.171391 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.171532 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.171673 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.171808 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.171949 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.172084 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.172217 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.172359 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.172505 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.172711 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.172902 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.173058 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.173204 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.173348 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.173508 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.173606 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.173688 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.173780 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.173937 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.174085 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.174323 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.174486 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.174574 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.174654 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.174879 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.175029 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.175207 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.175341 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.175488 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.175595 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.175786 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.175881 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.176079 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.176172 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.176377 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.176479 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.176659 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.176795 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.176954 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.177083 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.177249 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.177410 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.177563 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.177705 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.177840 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.177973 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.178120 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.178278 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.178447 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.178546 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.178690 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.178776 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.178985 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.179079 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.179280 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.179365 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.179575 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.179668 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.179870 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.180004 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.180228 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.180326 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.180523 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.180708 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.180813 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.180907 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.181108 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.181192 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.181404 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.181500 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.181698 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.181795 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.181993 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.182085 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.182286 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.182401 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.182607 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.182703 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.182904 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.182996 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.183206 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.183302 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.183495 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.183688 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.183835 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.183982 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.184121 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.184255 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.184400 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.184532 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.184667 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.184820 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.184962 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.185098 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.185232 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.185445 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.185598 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.185730 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.185821 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.185902 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.186047 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.186135 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.186337 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.186453 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.186661 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.186753 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.186969 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.187055 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.187264 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.187349 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.187563 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.187709 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.187850 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.187984 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.188159 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.188294 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.188437 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.188567 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.188747 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.188881 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.189044 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.189178 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.189339 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.189490 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.189626 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.189760 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.189914 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.190052 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.190191 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.190343 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.190519 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.190645 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.190791 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.190953 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.191085 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.191274 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.191361 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.191590 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.191675 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.191895 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.191993 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.192200 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.192285 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.192522 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.192607 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.192815 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.192908 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.193123 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:06:14.193209 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.193432 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.193517 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.193745 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.193855 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.194055 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.194154 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.194358 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.194465 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.194700 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.194795 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.195022 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.195105 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.195330 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.195434 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.195767 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.195917 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.196111 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.196215 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.196385 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.196531 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.196688 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.196789 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.196993 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.197116 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.197297 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.197437 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.197610 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.197737 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.197919 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.198038 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.198245 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.198338 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.198580 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.198675 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.198887 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.198980 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.199200 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.199286 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.199506 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.199593 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.199816 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.199909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.200138 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.200227 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.200453 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.200547 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.200756 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.200852 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.201060 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.201145 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.201390 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.201476 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.201701 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.201787 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.202010 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.202104 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.202318 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.202424 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.202650 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.202745 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.202956 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.203050 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.203258 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.203343 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.203564 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.203656 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.203869 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.203976 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.204168 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.204262 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.204468 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.204552 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.204774 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.204866 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.205070 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.205156 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.205373 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.205465 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.205679 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.205765 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.205983 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.206070 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.206307 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.206439 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.206636 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.206724 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.206943 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.207036 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.207247 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.207331 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.207551 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.207647 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.207849 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.207934 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.208157 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.208242 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.208462 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.208554 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.208758 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.208842 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.209059 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.209152 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.209359 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.209445 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.209657 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.209743 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.209954 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.210047 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.210262 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.210354 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.210587 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.210672 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.210892 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.210991 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.211219 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.211318 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.211529 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.211677 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.211837 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.211984 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.212120 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.212208 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.212421 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.212513 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.212717 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.212804 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.213023 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.213109 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.213328 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.213427 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.213625 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.213710 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.213945 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.214066 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.214248 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.214348 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.214570 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.214668 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.214883 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.214971 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.215183 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.215270 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.215481 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.215569 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.215778 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.215864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.216078 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.216181 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.216376 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.216463 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.216677 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.216763 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.216972 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.217066 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.217271 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.217358 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.217571 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.217658 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.217873 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.217994 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.218169 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.218256 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.218507 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.218595 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.218810 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.218914 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.219109 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.219195 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.219408 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.219494 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.219704 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.219790 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.220007 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.220091 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.220309 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.220394 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.220608 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.220695 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.220907 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.220993 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.221204 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.221297 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.221508 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.221594 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.221805 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.221891 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.222101 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.222195 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.222414 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.222504 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.222714 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.222799 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.223012 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.223108 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.223313 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.223398 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.223617 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.223701 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.223917 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.224024 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.224216 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.224321 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.224508 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.224593 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.224820 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.224915 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.225121 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.225207 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.225431 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.225528 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.225728 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.225823 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.226042 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.226148 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.226354 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.226472 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.226677 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.226790 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.227049 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.227145 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.227353 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.227446 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.227656 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.227804 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.227963 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.228119 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.228257 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.228423 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.228561 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.228739 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.228892 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.229043 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.229153 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.229355 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.229449 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.229657 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.229744 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.229972 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.230058 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.230276 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.230407 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.230612 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.230706 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.230909 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.231003 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.231217 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.231304 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.231525 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.231610 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.231829 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.231915 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.232149 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.232236 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.232460 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.232545 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.232763 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.232857 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.233066 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.233151 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.233369 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.233454 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.233667 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.233758 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.233966 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.234051 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.234272 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.234392 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.234602 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.234712 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.234902 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.235009 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.235203 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.235298 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.235501 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.235685 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.235802 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.235901 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.236118 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.236238 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.236399 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.236494 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.236691 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.236783 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.236993 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.237087 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.237288 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.237386 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.237582 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.237667 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.237884 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.237970 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.238198 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.238293 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.238528 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.238617 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.238829 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.238957 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.239131 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.239217 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.239429 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.239513 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.239725 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.239810 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.240026 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.240121 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.240327 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.240412 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.240624 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.240708 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.240922 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.241016 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.241219 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.241304 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.241512 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.241596 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.241821 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.241914 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.242124 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.242210 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.242476 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.242588 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.242776 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.242861 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.243080 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.243173 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.243395 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.243489 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.243701 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.243832 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.244015 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.244100 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.244343 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.244483 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.244628 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.244713 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.244925 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.245010 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.245239 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.245332 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.245541 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.245626 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.245839 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.245924 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.246139 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.246225 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.246457 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.246554 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.246772 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.246857 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.247081 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.247168 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.247375 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.247460 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.247671 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.247762 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.247979 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.248077 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.248287 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.248373 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.248597 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.248860 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.248955 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.249189 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.249285 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.249502 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.249588 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.249807 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.249893 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.250111 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.250204 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.250460 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.250543 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.250728 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.250817 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.251032 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.251125 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.251337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.251422 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.251651 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.251749 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.251955 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.252040 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.252258 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.252349 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.252557 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.252651 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.252851 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.252935 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.253147 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.253232 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.253450 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.253544 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.253750 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.254007 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.254093 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.254333 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.254464 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.254659 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.254755 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.254955 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.255040 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.255252 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.255346 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.255559 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.255963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.256173 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.256259 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.256479 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.256580 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.256774 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.256860 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.257087 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.257186 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.257388 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.257475 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.257687 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.257773 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.257982 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.258106 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.258360 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.258492 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.258682 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.258836 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.258984 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.259173 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.259267 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.259473 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.259642 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.259798 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.259883 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.260135 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.260228 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.260429 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.260522 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.260726 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.260811 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.261034 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.261119 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.261329 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.261414 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.261628 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.261713 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.261923 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.262007 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.262226 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.262312 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.262551 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.262640 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.262847 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.262931 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.263143 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.263228 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.263438 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.263524 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.263737 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.263835 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.264039 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.264125 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.264336 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.264459 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.264642 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.264737 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.264938 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.265024 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.265243 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.265330 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.265546 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.265640 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.265844 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.265930 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.266145 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.266229 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.266459 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.266607 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.266758 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.266845 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.267059 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.267157 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.267360 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.267454 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.267657 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.267740 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.267956 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.268040 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.268256 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.268341 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.268553 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.268647 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.268849 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.268936 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.269142 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.269270 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.269442 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.269526 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.269736 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.269829 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.270039 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.270125 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.270340 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.270453 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.270659 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.270759 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.270957 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.271042 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.271256 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.271348 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.271552 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.271649 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.271849 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.271941 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.272149 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.272233 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.272447 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.272541 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.272757 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.272841 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.273053 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.273149 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.273347 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.273439 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.273644 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.273747 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.273964 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.274049 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.274264 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.274351 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.274595 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.274695 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.274894 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.274991 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.275192 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.275286 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.275488 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.275573 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.275786 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.275879 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.276082 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.276168 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.276400 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.276486 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.276701 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.276803 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.276998 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.277095 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.277296 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.277383 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.277591 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.277685 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.277889 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.277975 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.278197 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.278282 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.278572 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.278678 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.278870 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.278955 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.279165 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.279263 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.279466 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.279563 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.279761 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.279853 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.280054 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.280146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.280349 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.280448 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.280644 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.280729 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.280938 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.281022 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.281240 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.281325 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.281539 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.281625 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.281835 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.281918 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.282131 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.282258 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.282451 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.282539 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.282761 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.282857 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.283062 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.283191 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.283376 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.283461 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.283690 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.283776 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.283994 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.284079 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.284290 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.284374 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.284597 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.284691 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.284896 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.284980 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.285195 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.285280 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.285488 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.285581 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.285787 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.285872 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.286083 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.286168 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.286412 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.286515 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.286703 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.286789 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.286999 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.287085 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.287299 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.287468 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.287597 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.287684 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.287895 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.287986 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.288195 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.288280 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.288491 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.288576 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.288805 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.288894 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.289099 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.289184 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.289440 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.289539 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.289746 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.289889 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.290068 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.290195 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.290348 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.290525 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.290671 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.290830 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.291088 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.291174 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.291392 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.291487 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.291699 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.291793 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.291997 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.292083 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.292298 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.292383 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.292599 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.292693 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.292907 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.292993 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.293213 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.293300 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.293509 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.293603 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.293822 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.293908 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.294124 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.294222 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.294447 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.294549 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.294753 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.294839 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.295056 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.295158 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.295358 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.295453 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.295657 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.295749 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.295996 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.296080 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.296295 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.296381 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.296596 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.296681 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.296896 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.296982 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.297215 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.297301 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.297514 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.297599 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.297820 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.297903 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.298132 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.298221 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.298455 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.298556 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.298836 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.298920 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.299154 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.299239 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.299458 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.299580 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.299760 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.299854 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.300058 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.300152 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.300356 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.300441 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.300657 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.300752 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.300973 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.301058 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.301269 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.301355 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.301565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.301659 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.301862 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.301949 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.302176 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.302268 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.302504 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.302594 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.302819 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.302915 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.303119 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.303225 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.303438 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.303551 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.303754 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.303849 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.304062 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.304204 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.304380 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.304509 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.304792 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.304878 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.305138 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.305231 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.305451 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.305544 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.305764 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.305858 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.306060 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.306145 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.306382 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.306473 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.306687 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.306774 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.306991 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.307074 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.307292 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.307377 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.307596 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.307693 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.307900 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.307986 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.308195 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.308288 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.308499 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.308584 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.308804 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.308935 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.309106 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.309199 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.309401 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.309486 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.309698 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.309812 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.310013 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.310128 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.310312 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.310451 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.310652 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.310767 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.310965 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.311089 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.311284 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.311384 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.311602 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.311687 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.311904 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.311991 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.312222 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.312308 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.312525 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.312618 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.312824 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.312911 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.313122 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.313207 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.313419 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.313503 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.313720 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.313814 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.314023 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.314109 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.314321 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.314477 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.314639 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.314726 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.314952 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.315039 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.315250 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.315361 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.315560 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.315646 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.315864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.315951 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.316182 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.316277 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.316490 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.316575 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.316788 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.316873 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.317093 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.317187 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.317392 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.317479 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.317687 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.317781 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.317984 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.318078 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.318281 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.318386 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.318613 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.318710 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.318914 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.319046 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.319211 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.319298 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.319508 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.319593 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.319805 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.319892 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.320119 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.320206 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.320417 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.320511 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.320777 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.320875 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.321080 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.321166 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.321377 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.321471 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.321675 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.321761 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.321971 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.322057 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.322266 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.322358 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.322593 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.322679 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.322892 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.322976 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.323191 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.323286 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.323488 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.323575 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.323789 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.323876 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.324085 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.324182 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.324382 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.324468 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.324678 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.324763 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.324991 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.325077 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.325288 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.325380 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.325602 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.325689 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.325903 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.325992 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.326199 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.326292 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.326519 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.326607 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.326816 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.326910 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.327126 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.327219 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.327437 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.327522 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.327746 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.327833 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.328062 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.328264 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.328378 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.328589 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.328701 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.328901 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.329025 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.329208 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.329297 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.329520 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.329607 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.329829 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.329922 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.330139 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.330224 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.330477 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.330567 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.330786 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.330872 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.331094 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.331179 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.331402 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.331497 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.331702 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.331786 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.332011 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.332114 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.332319 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.332404 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.332627 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.332713 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.332948 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.333148 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.333258 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.333473 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.333559 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.333786 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.333879 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.334096 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.334182 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.334430 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.334519 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.334744 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.334842 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.335056 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.335149 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.335365 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.335450 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.335672 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.335766 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.335979 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.336067 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.336314 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.336400 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.336629 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.336778 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.336936 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.337023 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.337245 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.337332 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.337548 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.337635 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.337855 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.337949 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.338164 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.338251 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.338517 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.338609 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.338845 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.338940 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.339162 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.339294 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.339472 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.339582 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.339780 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.339898 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.340088 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.340260 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.340401 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.340602 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.340711 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.340915 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.341001 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.341247 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.341336 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.341568 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.341654 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.341888 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.341983 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.342190 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.342275 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.342520 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.342609 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.342830 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.342929 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.343131 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.343216 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.343431 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.343517 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.343736 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.343830 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.344040 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.344140 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.344339 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.344426 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.344645 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.344731 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.344948 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.345034 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.345245 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.345457 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.345557 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.345768 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.345855 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.346094 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.346360 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.346459 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.346729 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.346818 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.347042 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.347127 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.347350 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.347435 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.347668 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.347754 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.347971 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.348056 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.348269 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.348365 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.348573 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.348662 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.348869 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.348954 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.349162 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.349314 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.349470 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.349556 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.349769 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.349854 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.350066 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.350172 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.350362 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.350495 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.350684 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.350770 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.350983 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.351209 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.351303 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.351548 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.351640 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.351902 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.352041 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.352230 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.352422 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.352505 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.352594 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.352798 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.352894 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.353095 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.353188 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.353401 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.353486 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.353698 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.353798 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.353997 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.354091 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.354294 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.354417 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.354623 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.354721 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.354923 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.355011 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.355219 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.355305 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.355521 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.355615 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.355816 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.355900 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.356108 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.356200 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.356402 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.356496 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.356695 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.356781 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.357017 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.357104 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.357314 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.357409 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.357612 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.357707 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.357907 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.357992 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.358210 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.358303 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.358533 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.358634 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.358833 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.358931 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.359131 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.359218 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.359427 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.359523 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.359730 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.359826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.360024 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.360124 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.360327 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.360574 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.360661 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.360905 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.360999 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.361200 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.361285 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.361499 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.361584 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.361842 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.361929 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.362145 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.362228 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.362463 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.362564 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.362762 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.362853 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.363070 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.363162 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.363372 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.363471 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.363674 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.363759 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.363977 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.364063 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.364278 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.364372 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.364582 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.364682 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.364885 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.364979 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.365188 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.365424 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.365512 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.365750 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.365836 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.366063 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.366160 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.366409 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.366500 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.366690 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.366776 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.366995 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.367093 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.367292 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.367377 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.367635 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.367719 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.367945 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.368115 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.368251 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.368434 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.368557 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.368748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.368907 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.369058 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.369145 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.369365 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.369499 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.369671 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.369766 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.369978 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.370064 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.370282 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.370441 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.370619 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.370719 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.370922 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.371016 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.371225 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.371319 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.371521 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.371607 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.371821 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.371930 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.372127 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.372234 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.372461 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.372549 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.372770 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.372869 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.373080 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.373172 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.373388 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.373475 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.373695 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.373781 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.373996 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.374091 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.374297 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.374402 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.374624 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.374711 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.374926 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.375021 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.375233 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.375319 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.375554 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.375642 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.375859 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.375954 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.376156 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.376242 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.376469 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.376562 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.376768 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.376863 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.377071 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.377157 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.377383 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.377468 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.377687 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.377780 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.377984 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.378070 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.378282 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.378415 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.378611 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.378698 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.378908 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.379000 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.379209 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.379295 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.379506 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.379592 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.379806 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.379901 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.380109 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.380208 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.380404 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.380535 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.381012 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.381107 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.381310 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.381405 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.381608 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.381701 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.381904 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.381996 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.382201 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.382336 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.382523 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.382609 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.382818 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.382911 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.383197 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.383330 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.383552 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.383648 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.383851 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.383978 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.384151 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.384279 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.384447 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.384606 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.384743 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.384940 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.385041 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.385249 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.385336 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.385566 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.385661 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.385873 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.385969 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.386166 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.386252 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.386490 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.386595 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.386787 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.386888 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.387087 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.387174 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.387382 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.387477 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.387695 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.387782 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.387980 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.388076 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.388273 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.388359 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.388568 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.388664 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.388871 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.388957 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.389175 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.389261 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.389478 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.389590 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.389895 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.389992 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.390073 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.390162 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.390403 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.390494 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.390711 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.390805 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.391020 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.391115 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.391329 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.391416 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.391632 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.391721 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.391935 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.392031 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.392234 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.392320 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.392549 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.392642 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.392851 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.392945 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.393150 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.393246 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.393450 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.393546 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.393750 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.393837 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.394051 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.394143 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.394355 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.394459 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.394690 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.394780 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.394988 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.395074 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.395304 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.395442 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.395604 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.395693 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.395915 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.396001 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.396221 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.396321 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.396521 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.396609 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.396840 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.396935 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.397144 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.397312 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.397444 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.397539 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.397752 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.397840 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.398055 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.398160 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.398350 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.398464 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.398612 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 04:06:14.398699 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.399014 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.399441 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.399763 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.400066 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.400383 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.400701 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.401044 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.401350 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.401684 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.402005 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.402313 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.402640 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.402940 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:06:14.403179 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 04:06:14.459260 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO dbcounter [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] Registered counter for database nova_api Jul 04 04:06:14.467158 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO dbcounter [None req-bd3b5838-ac14-4236-9cf4-815ac43f87df None None] Registered counter for database nova_api Jul 04 04:06:14.574631 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_db.sqlalchemy.engines [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 04:06:14.579505 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG oslo_db.sqlalchemy.engines [None req-bd3b5838-ac14-4236-9cf4-815ac43f87df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 04:06:14.582011 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writer thread running {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 04:06:14.586420 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writer thread running {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 04:06:14.637476 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.context [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0ce0899c-f5f4-4daa-b092-f0b42011e739(cell1) {{(pid=103337) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 04:06:14.641404 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.context [None req-bd3b5838-ac14-4236-9cf4-815ac43f87df None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0ce0899c-f5f4-4daa-b092-f0b42011e739(cell1) {{(pid=103338) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 04:06:14.641638 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:06:14.643235 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:06:14.644033 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:06:14.645504 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG oslo_concurrency.lockutils [None req-bd3b5838-ac14-4236-9cf4-815ac43f87df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:06:14.646114 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:06:14.647092 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG oslo_concurrency.lockutils [None req-bd3b5838-ac14-4236-9cf4-815ac43f87df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:06:14.647873 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG oslo_concurrency.lockutils [None req-bd3b5838-ac14-4236-9cf4-815ac43f87df None None] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:06:14.648144 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO dbcounter [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] Registered counter for database nova_cell0 Jul 04 04:06:14.649999 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG oslo_concurrency.lockutils [None req-bd3b5838-ac14-4236-9cf4-815ac43f87df None None] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103338) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:06:14.652109 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO dbcounter [None req-bd3b5838-ac14-4236-9cf4-815ac43f87df None None] Registered counter for database nova_cell0 Jul 04 04:06:14.652262 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO dbcounter [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] Registered counter for database nova_cell1 Jul 04 04:06:14.655997 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO dbcounter [None req-bd3b5838-ac14-4236-9cf4-815ac43f87df None None] Registered counter for database nova_cell1 Jul 04 04:06:14.660154 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_db.sqlalchemy.engines [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 04:06:14.661508 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_db.sqlalchemy.engines [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 04:06:14.663468 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG oslo_db.sqlalchemy.engines [None req-bd3b5838-ac14-4236-9cf4-815ac43f87df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 04:06:14.666751 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG oslo_db.sqlalchemy.engines [None req-bd3b5838-ac14-4236-9cf4-815ac43f87df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 04:06:14.668233 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writer thread running {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 04:06:14.670064 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writer thread running {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 04:06:14.670725 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writer thread running {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 04:06:14.806104 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writer thread running {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 04:06:14.812944 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO dbcounter [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] Registered counter for database nova_cell0 Jul 04 04:06:14.815725 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO dbcounter [None req-bd3b5838-ac14-4236-9cf4-815ac43f87df None None] Registered counter for database nova_cell0 Jul 04 04:06:14.823662 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_db.sqlalchemy.engines [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 04:06:14.825301 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG oslo_db.sqlalchemy.engines [None req-bd3b5838-ac14-4236-9cf4-815ac43f87df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 04:06:14.828639 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writer thread running {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 04:06:14.830202 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writer thread running {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 04:06:15.160920 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: WARNING keystonemiddleware.auth_token [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 04:06:15.163577 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: WARNING keystonemiddleware.auth_token [None req-bd3b5838-ac14-4236-9cf4-815ac43f87df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 04:06:15.168200 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: WARNING keystonemiddleware.auth_token [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 04:06:15.170905 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: WARNING keystonemiddleware.auth_token [None req-bd3b5838-ac14-4236-9cf4-815ac43f87df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 04:06:15.503870 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: WARNING keystonemiddleware.auth_token [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 04:06:15.509678 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: WARNING keystonemiddleware.auth_token [None req-bd3b5838-ac14-4236-9cf4-815ac43f87df None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 04:06:15.510185 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: WARNING keystonemiddleware.auth_token [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 04:06:15.515420 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5599bcbaa9c0 pid: 103337 (default app) Jul 04 04:06:15.515647 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: WARNING keystonemiddleware.auth_token [None req-bd3b5838-ac14-4236-9cf4-815ac43f87df None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 04:06:15.517505 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:06:15.518726 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001755 Jul 04 04:06:15.519134 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Mon Jul 4 04:06:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:06:15.520846 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5599bcbaa9c0 pid: 103338 (default app) Jul 04 04:07:30.802718 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:07:30.803973 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001735 Jul 04 04:07:30.804392 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jul 4 04:07:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:07:30.816599 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writing DB stats nova_api:SELECT=3 {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:07:30.817873 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writing DB stats nova_cell0:SELECT=3 {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:07:30.818906 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writing DB stats nova_cell1:SELECT=3 {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:07:30.819908 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:07:31.242428 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-78989863-42cd-40c8-9b13-d3b1250b8a80 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:07:31.272221 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-78989863-42cd-40c8-9b13-d3b1250b8a80 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.460859 Jul 04 04:07:31.272965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1291 bytes} [Mon Jul 4 04:07:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:07:33.318570 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:07:33.319758 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-e31c170a-615a-44d8-bb99-3311d25603b5 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001647 Jul 04 04:07:33.320539 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jul 4 04:07:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:07:33.386597 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-4fbb3eb9-43df-4d5d-b3d7-43ef994960c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:33.406279 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:07:33.406279 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: warnings.warn(msg) Jul 04 04:07:33.439253 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-4fbb3eb9-43df-4d5d-b3d7-43ef994960c1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.112118 Jul 04 04:07:33.439726 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jul 4 04:07:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:07:33.455196 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_api:SELECT=3 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:07:33.456842 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_cell0:SELECT=3 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:07:33.457995 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_cell1:SELECT=3 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:07:33.459001 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:07:33.663758 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-0a309ac7-c1e6-41e3-a3aa-f0933797d1d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:33.666193 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:07:33.666193 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: warnings.warn(msg) Jul 04 04:07:33.731577 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-0a309ac7-c1e6-41e3-a3aa-f0933797d1d8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282762 Jul 04 04:07:33.732263 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1335 bytes} [Mon Jul 4 04:07:33 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:07:35.808643 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-4fbb3eb9-43df-4d5d-b3d7-43ef994960c1 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:07:35.809586 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-4fbb3eb9-43df-4d5d-b3d7-43ef994960c1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 04 04:07:35.810019 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jul 4 04:07:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:07:35.917341 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-4b8ca3b7-7665-4f4e-bd6c-f738f08c5bdc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "id": "d1", "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:35.935112 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:07:35.935112 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: warnings.warn(msg) Jul 04 04:07:35.955181 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-4b8ca3b7-7665-4f4e-bd6c-f738f08c5bdc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139383 Jul 04 04:07:35.955748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jul 4 04:07:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:07:35.967727 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-48d5c95a-1e80-4da1-a681-704ddd9b0d2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:35.969210 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:07:35.969210 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: warnings.warn(msg) Jul 04 04:07:36.010332 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-48d5c95a-1e80-4da1-a681-704ddd9b0d2e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046266 Jul 04 04:07:36.010972 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1335 bytes} [Mon Jul 4 04:07:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:07:38.153690 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-4b8ca3b7-7665-4f4e-bd6c-f738f08c5bdc admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:07:38.154749 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-4b8ca3b7-7665-4f4e-bd6c-f738f08c5bdc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 04 04:07:38.155164 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jul 4 04:07:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:07:38.218497 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-c2e6ba32-2921-415e-a41e-d9d19fb65c44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d2", "swap": 0}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:38.240063 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-c2e6ba32-2921-415e-a41e-d9d19fb65c44 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078526 Jul 04 04:07:38.242690 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jul 4 04:07:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:07:38.252732 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-3e8dee16-3b38-4c0e-bd68-83f173acb349 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:38.281457 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-3e8dee16-3b38-4c0e-bd68-83f173acb349 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032473 Jul 04 04:07:38.289863 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1335 bytes} [Mon Jul 4 04:07:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:07:40.363056 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-c2e6ba32-2921-415e-a41e-d9d19fb65c44 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:07:40.364221 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-c2e6ba32-2921-415e-a41e-d9d19fb65c44 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001621 Jul 04 04:07:40.364814 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jul 4 04:07:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:07:40.427020 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-d93e9988-437a-4cf8-892b-2b34ef6ab501 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "name": "ds2G", "id": "d3", "swap": 0}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:40.445458 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-d93e9988-437a-4cf8-892b-2b34ef6ab501 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074863 Jul 04 04:07:40.446008 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jul 4 04:07:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:07:40.457824 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-47156e7a-902d-4541-917f-c9e918b72b74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:40.481861 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-47156e7a-902d-4541-917f-c9e918b72b74 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027754 Jul 04 04:07:40.482490 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1335 bytes} [Mon Jul 4 04:07:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:07:42.531553 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-d93e9988-437a-4cf8-892b-2b34ef6ab501 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:07:42.532571 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-d93e9988-437a-4cf8-892b-2b34ef6ab501 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jul 04 04:07:42.533123 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jul 4 04:07:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:07:42.597656 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-e25d4155-3510-4d5a-8a56-c3b0e36bd06d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "name": "ds4G"}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:42.616426 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-e25d4155-3510-4d5a-8a56-c3b0e36bd06d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077116 Jul 04 04:07:42.617126 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jul 4 04:07:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 04:07:42.632954 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-1c8efc50-e18d-4b9d-a0d2-406b09accbfb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:42.668781 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-1c8efc50-e18d-4b9d-a0d2-406b09accbfb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042573 Jul 04 04:07:42.669360 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1335 bytes} [Mon Jul 4 04:07:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:07:44.741102 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-e25d4155-3510-4d5a-8a56-c3b0e36bd06d admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:07:44.742112 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-e25d4155-3510-4d5a-8a56-c3b0e36bd06d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 04 04:07:44.742784 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jul 4 04:07:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:07:44.807735 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-7d6d69dd-58fa-421a-a12e-636d09c37356 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:07:44.832350 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-7d6d69dd-58fa-421a-a12e-636d09c37356 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083617 Jul 04 04:07:44.834421 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1291 bytes} [Mon Jul 4 04:07:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:07:46.910391 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-e25d4155-3510-4d5a-8a56-c3b0e36bd06d admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:07:46.912090 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-e25d4155-3510-4d5a-8a56-c3b0e36bd06d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002158 Jul 04 04:07:46.912586 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jul 4 04:07:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:07:46.985657 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-cb2aa3ef-1b66-4762-bd3f-9b7ec561780f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:47.007551 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-cb2aa3ef-1b66-4762-bd3f-9b7ec561780f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.087081 Jul 04 04:07:47.008307 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jul 4 04:07:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:07:47.027247 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-4cadaa57-0f57-4b73-9486-123d626f4658 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:47.061481 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-4cadaa57-0f57-4b73-9486-123d626f4658 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040169 Jul 04 04:07:47.062622 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1332 bytes} [Mon Jul 4 04:07:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:07:49.230989 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-cb2aa3ef-1b66-4762-bd3f-9b7ec561780f admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:07:49.232031 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-cb2aa3ef-1b66-4762-bd3f-9b7ec561780f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jul 04 04:07:49.232597 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jul 4 04:07:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:07:49.302831 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-719783c0-fa0c-40f0-a284-e9402646b8b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "ram": 2048, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:49.321629 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-719783c0-fa0c-40f0-a284-e9402646b8b2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083012 Jul 04 04:07:49.322166 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jul 4 04:07:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 04:07:49.334181 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-ede24145-229f-4243-a73f-b114413761f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:49.359810 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-ede24145-229f-4243-a73f-b114413761f2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029417 Jul 04 04:07:49.360367 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1332 bytes} [Mon Jul 4 04:07:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:07:51.501649 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-719783c0-fa0c-40f0-a284-e9402646b8b2 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:07:51.502840 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-719783c0-fa0c-40f0-a284-e9402646b8b2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Jul 04 04:07:51.503253 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jul 4 04:07:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:07:51.568468 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-6d93e89b-fa94-4317-83b8-fe5eb8d3fa90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "disk": 40, "name": "m1.medium", "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:51.588458 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-6d93e89b-fa94-4317-83b8-fe5eb8d3fa90 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.078182 Jul 04 04:07:51.589023 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jul 4 04:07:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:07:51.604764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-8901636d-a176-40fe-b44f-eb1e1771e6fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:51.643329 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-8901636d-a176-40fe-b44f-eb1e1771e6fe admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045688 Jul 04 04:07:51.644180 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1332 bytes} [Mon Jul 4 04:07:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:07:53.725918 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-6d93e89b-fa94-4317-83b8-fe5eb8d3fa90 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:07:53.726975 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-6d93e89b-fa94-4317-83b8-fe5eb8d3fa90 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Jul 04 04:07:53.727376 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jul 4 04:07:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:07:53.788281 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-fbfc3246-e805-47b5-9a4a-55207fca788c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "name": "m1.large", "disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "ram": 8192, "os-flavor-access:is_public": true}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:53.807543 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-fbfc3246-e805-47b5-9a4a-55207fca788c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074246 Jul 04 04:07:53.808335 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jul 4 04:07:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:07:53.820218 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-d161c03c-f30b-4962-9244-368e1111e6d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:53.843939 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-d161c03c-f30b-4962-9244-368e1111e6d8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027442 Jul 04 04:07:53.844547 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1332 bytes} [Mon Jul 4 04:07:53 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:07:55.916678 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-fbfc3246-e805-47b5-9a4a-55207fca788c admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:07:55.918409 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-fbfc3246-e805-47b5-9a4a-55207fca788c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002123 Jul 04 04:07:55.918980 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jul 4 04:07:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:07:55.981158 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-c570a010-5804-48dd-b982-703ceb312bd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge", "disk": 160, "vcpus": 8, "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:56.003368 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-c570a010-5804-48dd-b982-703ceb312bd6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078097 Jul 04 04:07:56.004616 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1282 bytes} [Mon Jul 4 04:07:55 2022] POST /compute/v2.1/flavors => generated 408 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:07:56.016849 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-aa780e1d-78d5-4c2d-8ee8-e7c9fc47aaa0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:07:56.058652 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-aa780e1d-78d5-4c2d-8ee8-e7c9fc47aaa0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045445 Jul 04 04:07:56.062095 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1332 bytes} [Mon Jul 4 04:07:56 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:08:20.683462 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-c570a010-5804-48dd-b982-703ceb312bd6 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:20.684861 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-c570a010-5804-48dd-b982-703ceb312bd6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002155 Jul 04 04:08:20.685481 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jul 4 04:08:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:08:20.703297 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:08:20.755178 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-d4e80565-1eca-4068-9ab0-08fc0d17855c admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:20.772397 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-d4e80565-1eca-4068-9ab0-08fc0d17855c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.076745 Jul 04 04:08:20.772929 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1291 bytes} [Mon Jul 4 04:08:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:08:21.706052 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-c570a010-5804-48dd-b982-703ceb312bd6 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:21.707313 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-c570a010-5804-48dd-b982-703ceb312bd6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 04 04:08:21.707851 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jul 4 04:08:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:08:21.904481 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-3ab654d6-06af-4353-9a66-36ffd3a0d4dc admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:21.912117 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.wsgi [None req-3ab654d6-06af-4353-9a66-36ffd3a0d4dc admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-3ab654d6-06af-4353-9a66-36ffd3a0d4dc admin admin] Request method failure captured: Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Accept: application/json Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Accept-Encoding: gzip, deflate Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Connection: keep-alive Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Content-Length: 0 Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Host: 10.222.0.16 Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Openstack-Api-Version: compute 2.90 Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Openstack-System-Scope: None Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: User-Agent: python-novaclient Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Auth-Token: gAAAAABiwme1Th7eavejgnwESipz8zm3uQ8UKc0GOrP2pRnDtjwLadRwQBRndwHNcn7QxS9bTCpvXaAO5MTbXAJOa5TaoEsto9uj-_NgTsMakqlDe1Yx-gIQ8V6L1GD94p6bhENn3jXXXT-0sFqMssnvZQo3nBK6-1HKYPJZXZ4qeOwJgUM6Sgg Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Domain-Id: None Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Domain-Name: None Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Identity-Status: Confirmed Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Is-Admin-Project: True Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Project-Domain-Id: default Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Project-Domain-Name: Default Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Project-Id: 525d4bbd65cc40f382674c9a7977e83e Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Project-Name: admin Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Role: member,admin,reader Jul 04 04:08:21.915963 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Roles: member,admin,reader Jul 04 04:08:21.917572 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/525d4bbd65cc40f382674c9a7977e83e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/525d4bbd65cc40f382674c9a7977e83e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/525d4bbd65cc40f382674c9a7977e83e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_525d4bbd65cc40f382674c9a7977e83e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:08:21.917572 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Tenant: admin Jul 04 04:08:21.917572 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Tenant-Id: 525d4bbd65cc40f382674c9a7977e83e Jul 04 04:08:21.917572 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Tenant-Name: admin Jul 04 04:08:21.917572 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-User: admin Jul 04 04:08:21.917572 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-User-Domain-Id: default Jul 04 04:08:21.917572 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-User-Domain-Name: Default Jul 04 04:08:21.917572 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-User-Id: 769a75081be74879911bd8c4f4cb57da Jul 04 04:08:21.917572 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-User-Name: admin Jul 04 04:08:21.917572 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: method: > Jul 04 04:08:21.917572 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: exception: Flavor 42 could not be found. Jul 04 04:08:21.917572 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: action_args: {'id': '42'} Jul 04 04:08:21.917572 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:08:21.917572 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:08:21.918565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 04:08:21.918565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 04:08:21.918565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 04:08:21.918565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 04:08:21.918565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 04:08:21.918565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 04:08:21.918565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 04:08:21.918565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 04:08:21.918565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 04:08:21.918565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:08:21.918565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 04:08:21.918565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 04:08:21.918565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 04 04:08:21.918565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Jul 04 04:08:21.918565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:08:21.918565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Jul 04 04:08:21.918565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:08:21.918565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:08:21.918565 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:08:21.919864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:08:21.919864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:08:21.919864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:08:21.919864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:08:21.919864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 04:08:21.919864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:08:21.919864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 04 04:08:21.919864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Jul 04 04:08:21.919864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:08:21.919864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Jul 04 04:08:21.919864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:08:21.919864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:08:21.919864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:08:21.919864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:08:21.919864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:08:21.919864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 04 04:08:21.919864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Jul 04 04:08:21.919864 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-3ab654d6-06af-4353-9a66-36ffd3a0d4dc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:08:21.921165 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-3ab654d6-06af-4353-9a66-36ffd3a0d4dc admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.073952 Jul 04 04:08:21.921165 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Jul 4 04:08:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 04:08:21.927813 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-ead1c10e-74a5-402d-8f77-842eb81e021c admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:21.930909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:08:21.949848 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-ead1c10e-74a5-402d-8f77-842eb81e021c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025700 Jul 04 04:08:21.950643 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Jul 4 04:08:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 04:08:21.960934 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-e5dafff3-550e-4003-b2cc-a34eddbe9663 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:21.982277 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-e5dafff3-550e-4003-b2cc-a34eddbe9663 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025396 Jul 04 04:08:21.982839 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Jul 4 04:08:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:08:21.992657 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-fa013f2f-e80b-4335-888c-245f780bbbbf admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:21.998892 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.wsgi [None req-fa013f2f-e80b-4335-888c-245f780bbbbf admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-fa013f2f-e80b-4335-888c-245f780bbbbf admin admin] Request method failure captured: Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Accept: application/json Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Accept-Encoding: gzip, deflate Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Connection: keep-alive Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Content-Length: 0 Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Host: 10.222.0.16 Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Openstack-Api-Version: compute 2.90 Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Openstack-System-Scope: None Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: User-Agent: python-novaclient Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Auth-Token: gAAAAABiwme1Th7eavejgnwESipz8zm3uQ8UKc0GOrP2pRnDtjwLadRwQBRndwHNcn7QxS9bTCpvXaAO5MTbXAJOa5TaoEsto9uj-_NgTsMakqlDe1Yx-gIQ8V6L1GD94p6bhENn3jXXXT-0sFqMssnvZQo3nBK6-1HKYPJZXZ4qeOwJgUM6Sgg Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Domain-Id: None Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Domain-Name: None Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Identity-Status: Confirmed Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Is-Admin-Project: True Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Project-Domain-Id: default Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Project-Domain-Name: Default Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Project-Id: 525d4bbd65cc40f382674c9a7977e83e Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Project-Name: admin Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Role: member,admin,reader Jul 04 04:08:22.002146 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Roles: member,admin,reader Jul 04 04:08:22.004188 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/525d4bbd65cc40f382674c9a7977e83e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/525d4bbd65cc40f382674c9a7977e83e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/525d4bbd65cc40f382674c9a7977e83e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_525d4bbd65cc40f382674c9a7977e83e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:08:22.004188 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Tenant: admin Jul 04 04:08:22.004188 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Tenant-Id: 525d4bbd65cc40f382674c9a7977e83e Jul 04 04:08:22.004188 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Tenant-Name: admin Jul 04 04:08:22.004188 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-User: admin Jul 04 04:08:22.004188 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-User-Domain-Id: default Jul 04 04:08:22.004188 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-User-Domain-Name: Default Jul 04 04:08:22.004188 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-User-Id: 769a75081be74879911bd8c4f4cb57da Jul 04 04:08:22.004188 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-User-Name: admin Jul 04 04:08:22.004188 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: method: > Jul 04 04:08:22.004188 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: exception: Flavor 42 could not be found. Jul 04 04:08:22.004188 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: action_args: {'id': '42'} Jul 04 04:08:22.004188 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:08:22.004188 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:08:22.006961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 04:08:22.006961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 04:08:22.006961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 04:08:22.006961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 04:08:22.006961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 04:08:22.006961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 04:08:22.006961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 04:08:22.006961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 04:08:22.006961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 04:08:22.006961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:08:22.006961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 04:08:22.006961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 04:08:22.006961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 04 04:08:22.006961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 04 04:08:22.006961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:08:22.006961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 04 04:08:22.006961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:08:22.006961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:08:22.006961 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:08:22.008257 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:08:22.008257 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:08:22.008257 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:08:22.008257 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:08:22.008257 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 04:08:22.008257 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:08:22.008257 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 04 04:08:22.008257 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 04 04:08:22.008257 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:08:22.008257 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 04 04:08:22.008257 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:08:22.008257 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:08:22.008257 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:08:22.008257 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:08:22.008257 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:08:22.008257 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 04 04:08:22.008257 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 04 04:08:22.008257 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-fa013f2f-e80b-4335-888c-245f780bbbbf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:08:22.009504 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-fa013f2f-e80b-4335-888c-245f780bbbbf admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015837 Jul 04 04:08:22.009504 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Jul 4 04:08:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 04:08:22.835772 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-e5dafff3-550e-4003-b2cc-a34eddbe9663 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:22.836778 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-e5dafff3-550e-4003-b2cc-a34eddbe9663 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 04 04:08:22.837131 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jul 4 04:08:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:08:23.042333 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-aba1adac-2d3c-4172-abd0-234c90fd9658 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:23.050775 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.wsgi [None req-aba1adac-2d3c-4172-abd0-234c90fd9658 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-aba1adac-2d3c-4172-abd0-234c90fd9658 admin admin] Request method failure captured: Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Accept: application/json Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Accept-Encoding: gzip, deflate Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Connection: keep-alive Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Content-Length: 0 Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Host: 10.222.0.16 Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Openstack-Api-Version: compute 2.90 Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Openstack-System-Scope: None Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: User-Agent: python-novaclient Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Auth-Token: gAAAAABiwme2tTJuR8Rvr0-6b6WX8G9j37YU-lh7pTV0Z2Cgu4jLOWMNEpRWt2e0PLgsoFoNQ9AmvnAiIwjtIZw3yVwUGugiiSAad13kZeKLO5BsYjcAoWN9w7y-Hc6UXIk6ja1ppDkZPv6fK86mHrCWvob51vo33IK7-miwz3mw2oh0BlMYQos Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Domain-Id: None Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Domain-Name: None Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Identity-Status: Confirmed Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Is-Admin-Project: True Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Project-Domain-Id: default Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Project-Domain-Name: Default Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Project-Id: 525d4bbd65cc40f382674c9a7977e83e Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Project-Name: admin Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Role: member,admin,reader Jul 04 04:08:23.052353 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Roles: member,admin,reader Jul 04 04:08:23.053875 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/525d4bbd65cc40f382674c9a7977e83e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/525d4bbd65cc40f382674c9a7977e83e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/525d4bbd65cc40f382674c9a7977e83e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_525d4bbd65cc40f382674c9a7977e83e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:08:23.053875 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Tenant: admin Jul 04 04:08:23.053875 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Tenant-Id: 525d4bbd65cc40f382674c9a7977e83e Jul 04 04:08:23.053875 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Tenant-Name: admin Jul 04 04:08:23.053875 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-User: admin Jul 04 04:08:23.053875 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-User-Domain-Id: default Jul 04 04:08:23.053875 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-User-Domain-Name: Default Jul 04 04:08:23.053875 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-User-Id: 769a75081be74879911bd8c4f4cb57da Jul 04 04:08:23.053875 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-User-Name: admin Jul 04 04:08:23.053875 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: method: > Jul 04 04:08:23.053875 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: exception: Flavor 84 could not be found. Jul 04 04:08:23.053875 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: action_args: {'id': '84'} Jul 04 04:08:23.053875 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:08:23.053875 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:08:23.054748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 04:08:23.054748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 04:08:23.054748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 04:08:23.054748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 04:08:23.054748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 04:08:23.054748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 04:08:23.054748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 04:08:23.054748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 04:08:23.054748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 04:08:23.054748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:08:23.054748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 04:08:23.054748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 04:08:23.054748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 04 04:08:23.054748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 04 04:08:23.054748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:08:23.054748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 04 04:08:23.054748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:08:23.054748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:08:23.054748 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:08:23.055826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:08:23.055826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:08:23.055826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:08:23.055826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:08:23.055826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 04:08:23.055826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:08:23.055826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 04 04:08:23.055826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 04 04:08:23.055826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:08:23.055826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 04 04:08:23.055826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:08:23.055826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:08:23.055826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:08:23.055826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:08:23.055826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:08:23.055826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 04 04:08:23.055826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 04 04:08:23.055826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-aba1adac-2d3c-4172-abd0-234c90fd9658 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:08:23.056834 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-aba1adac-2d3c-4172-abd0-234c90fd9658 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.077093 Jul 04 04:08:23.056834 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Jul 4 04:08:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 04:08:23.063598 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-f71daba2-0d6d-4ba3-b84d-db01b9da29e0 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:23.077511 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-f71daba2-0d6d-4ba3-b84d-db01b9da29e0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017599 Jul 04 04:08:23.078067 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Jul 4 04:08:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:08:23.087951 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-b2444d81-4838-4829-88a9-b9b35940cd0b admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:23.102111 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-b2444d81-4838-4829-88a9-b9b35940cd0b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017611 Jul 04 04:08:23.102813 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Jul 4 04:08:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:08:23.114190 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-76d49ab4-1dea-4f84-966c-e13fcd5556e4 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:23.119832 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.wsgi [None req-76d49ab4-1dea-4f84-966c-e13fcd5556e4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-76d49ab4-1dea-4f84-966c-e13fcd5556e4 admin admin] Request method failure captured: Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Accept: application/json Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Accept-Encoding: gzip, deflate Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Connection: keep-alive Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Content-Length: 0 Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Host: 10.222.0.16 Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Openstack-Api-Version: compute 2.90 Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Openstack-System-Scope: None Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: User-Agent: python-novaclient Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Auth-Token: gAAAAABiwme2tTJuR8Rvr0-6b6WX8G9j37YU-lh7pTV0Z2Cgu4jLOWMNEpRWt2e0PLgsoFoNQ9AmvnAiIwjtIZw3yVwUGugiiSAad13kZeKLO5BsYjcAoWN9w7y-Hc6UXIk6ja1ppDkZPv6fK86mHrCWvob51vo33IK7-miwz3mw2oh0BlMYQos Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Domain-Id: None Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Domain-Name: None Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Identity-Status: Confirmed Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Is-Admin-Project: True Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Project-Domain-Id: default Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Project-Domain-Name: Default Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Project-Id: 525d4bbd65cc40f382674c9a7977e83e Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Project-Name: admin Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Role: member,admin,reader Jul 04 04:08:23.121337 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Roles: member,admin,reader Jul 04 04:08:23.122838 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/525d4bbd65cc40f382674c9a7977e83e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/525d4bbd65cc40f382674c9a7977e83e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/525d4bbd65cc40f382674c9a7977e83e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_525d4bbd65cc40f382674c9a7977e83e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:08:23.122838 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Tenant: admin Jul 04 04:08:23.122838 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Tenant-Id: 525d4bbd65cc40f382674c9a7977e83e Jul 04 04:08:23.122838 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Tenant-Name: admin Jul 04 04:08:23.122838 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-User: admin Jul 04 04:08:23.122838 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-User-Domain-Id: default Jul 04 04:08:23.122838 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-User-Domain-Name: Default Jul 04 04:08:23.122838 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-User-Id: 769a75081be74879911bd8c4f4cb57da Jul 04 04:08:23.122838 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-User-Name: admin Jul 04 04:08:23.122838 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: method: > Jul 04 04:08:23.122838 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: exception: Flavor 84 could not be found. Jul 04 04:08:23.122838 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: action_args: {'id': '84'} Jul 04 04:08:23.122838 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:08:23.122838 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:08:23.123764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 04:08:23.123764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 04:08:23.123764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 04:08:23.123764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 04:08:23.123764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 04:08:23.123764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 04:08:23.123764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 04:08:23.123764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 04:08:23.123764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 04:08:23.123764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:08:23.123764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 04:08:23.123764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 04:08:23.123764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 04 04:08:23.123764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Jul 04 04:08:23.123764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:08:23.123764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Jul 04 04:08:23.123764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:08:23.123764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:08:23.123764 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:08:23.124826 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:08:23.124826 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:08:23.124826 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:08:23.124826 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:08:23.124826 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 04:08:23.124826 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:08:23.124826 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 04 04:08:23.124826 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Jul 04 04:08:23.124826 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:08:23.124826 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Jul 04 04:08:23.124826 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:08:23.124826 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:08:23.124826 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:08:23.124826 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:08:23.124826 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:08:23.124826 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 04 04:08:23.124826 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Jul 04 04:08:23.124826 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-76d49ab4-1dea-4f84-966c-e13fcd5556e4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:08:23.125834 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-76d49ab4-1dea-4f84-966c-e13fcd5556e4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013790 Jul 04 04:08:23.125834 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Mon Jul 4 04:08:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 04:08:23.997455 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-b2444d81-4838-4829-88a9-b9b35940cd0b admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:23.998503 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-b2444d81-4838-4829-88a9-b9b35940cd0b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 04 04:08:23.998899 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jul 4 04:08:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:08:24.211217 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-ac04f924-52bb-4c0e-a5e8-942136068a78 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:24.217161 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.wsgi [None req-ac04f924-52bb-4c0e-a5e8-942136068a78 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-ac04f924-52bb-4c0e-a5e8-942136068a78 admin admin] Request method failure captured: Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Accept: application/json Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Accept-Encoding: gzip, deflate Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Connection: keep-alive Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Content-Length: 0 Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Host: 10.222.0.16 Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Openstack-Api-Version: compute 2.90 Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Openstack-System-Scope: None Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: User-Agent: python-novaclient Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Auth-Token: gAAAAABiwme3Vh_fe7uv7t3WOtIlCoYeJMQ39n6IDIuK68wPC4UkzdzYyyZNYrdNluAEo26rMySnTxA1n-81XF_HZqqUpz3cJWA2kJTxtVHH_x4JWWFaM0cTCZQnlfZVrOJ3F0AWl6i13uiUqQ7n09T8-vF9TeVFKLbXytj0T4zrfa2VO0ATHTM Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Domain-Id: None Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Domain-Name: None Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Identity-Status: Confirmed Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Is-Admin-Project: True Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Project-Domain-Id: default Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Project-Domain-Name: Default Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Project-Id: 525d4bbd65cc40f382674c9a7977e83e Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Project-Name: admin Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Role: member,admin,reader Jul 04 04:08:24.218704 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Roles: member,admin,reader Jul 04 04:08:24.219988 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/525d4bbd65cc40f382674c9a7977e83e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/525d4bbd65cc40f382674c9a7977e83e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/525d4bbd65cc40f382674c9a7977e83e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_525d4bbd65cc40f382674c9a7977e83e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:08:24.219988 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Tenant: admin Jul 04 04:08:24.219988 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Tenant-Id: 525d4bbd65cc40f382674c9a7977e83e Jul 04 04:08:24.219988 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-Tenant-Name: admin Jul 04 04:08:24.219988 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-User: admin Jul 04 04:08:24.219988 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-User-Domain-Id: default Jul 04 04:08:24.219988 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-User-Domain-Name: Default Jul 04 04:08:24.219988 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-User-Id: 769a75081be74879911bd8c4f4cb57da Jul 04 04:08:24.219988 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: X-User-Name: admin Jul 04 04:08:24.219988 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: method: > Jul 04 04:08:24.219988 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: exception: Flavor 451 could not be found. Jul 04 04:08:24.219988 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: action_args: {'id': '451'} Jul 04 04:08:24.219988 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:08:24.219988 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:08:24.220965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 04:08:24.220965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 04:08:24.220965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 04:08:24.220965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 04:08:24.220965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 04:08:24.220965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 04:08:24.220965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 04:08:24.220965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 04:08:24.220965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 04:08:24.220965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:08:24.220965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 04:08:24.220965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 04:08:24.220965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 04 04:08:24.220965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Jul 04 04:08:24.220965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:08:24.220965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Jul 04 04:08:24.220965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:08:24.220965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:08:24.220965 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:08:24.222779 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:08:24.222779 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:08:24.222779 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:08:24.222779 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:08:24.222779 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 04:08:24.222779 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:08:24.222779 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 04 04:08:24.222779 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Jul 04 04:08:24.222779 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:08:24.222779 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Jul 04 04:08:24.222779 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:08:24.222779 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:08:24.222779 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:08:24.222779 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:08:24.222779 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:08:24.222779 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 04 04:08:24.222779 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: ERROR nova.api.openstack.wsgi Jul 04 04:08:24.222779 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-ac04f924-52bb-4c0e-a5e8-942136068a78 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103338) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:08:24.224035 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-ac04f924-52bb-4c0e-a5e8-942136068a78 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.080812 Jul 04 04:08:24.224035 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Jul 4 04:08:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 04:08:24.233324 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-02513584-802d-4488-b700-bb1efaddbbb7 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:24.254763 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-02513584-802d-4488-b700-bb1efaddbbb7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027018 Jul 04 04:08:24.255296 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Jul 4 04:08:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:08:24.267072 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-b09cd42b-16f8-489e-9605-083d04a04717 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:24.287962 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-b09cd42b-16f8-489e-9605-083d04a04717 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026519 Jul 04 04:08:24.288496 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Mon Jul 4 04:08:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 04:08:24.297907 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-1b9e45dd-97a1-4dac-bcc6-378b35d0c6c3 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:24.303406 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.wsgi [None req-1b9e45dd-97a1-4dac-bcc6-378b35d0c6c3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-1b9e45dd-97a1-4dac-bcc6-378b35d0c6c3 admin admin] Request method failure captured: Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Accept: application/json Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Accept-Encoding: gzip, deflate Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Connection: keep-alive Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Content-Length: 0 Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Host: 10.222.0.16 Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Openstack-Api-Version: compute 2.90 Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Openstack-System-Scope: None Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: User-Agent: python-novaclient Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Auth-Token: gAAAAABiwme3Vh_fe7uv7t3WOtIlCoYeJMQ39n6IDIuK68wPC4UkzdzYyyZNYrdNluAEo26rMySnTxA1n-81XF_HZqqUpz3cJWA2kJTxtVHH_x4JWWFaM0cTCZQnlfZVrOJ3F0AWl6i13uiUqQ7n09T8-vF9TeVFKLbXytj0T4zrfa2VO0ATHTM Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Domain-Id: None Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Domain-Name: None Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Identity-Status: Confirmed Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Is-Admin-Project: True Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Project-Domain-Id: default Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Project-Domain-Name: Default Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Project-Id: 525d4bbd65cc40f382674c9a7977e83e Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Project-Name: admin Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Role: member,admin,reader Jul 04 04:08:24.304897 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Roles: member,admin,reader Jul 04 04:08:24.306529 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/525d4bbd65cc40f382674c9a7977e83e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/525d4bbd65cc40f382674c9a7977e83e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/525d4bbd65cc40f382674c9a7977e83e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_525d4bbd65cc40f382674c9a7977e83e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:08:24.306529 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Tenant: admin Jul 04 04:08:24.306529 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Tenant-Id: 525d4bbd65cc40f382674c9a7977e83e Jul 04 04:08:24.306529 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-Tenant-Name: admin Jul 04 04:08:24.306529 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-User: admin Jul 04 04:08:24.306529 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-User-Domain-Id: default Jul 04 04:08:24.306529 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-User-Domain-Name: Default Jul 04 04:08:24.306529 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-User-Id: 769a75081be74879911bd8c4f4cb57da Jul 04 04:08:24.306529 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: X-User-Name: admin Jul 04 04:08:24.306529 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: method: > Jul 04 04:08:24.306529 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: exception: Flavor 451 could not be found. Jul 04 04:08:24.306529 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: action_args: {'id': '451'} Jul 04 04:08:24.306529 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:08:24.306529 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:08:24.307635 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 04:08:24.307635 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 04:08:24.307635 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 04:08:24.307635 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 04:08:24.307635 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 04:08:24.307635 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 04:08:24.307635 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 04:08:24.307635 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 04:08:24.307635 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 04:08:24.307635 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:08:24.307635 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 04:08:24.307635 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 04:08:24.307635 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 04 04:08:24.307635 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 04 04:08:24.307635 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:08:24.307635 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 04 04:08:24.307635 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:08:24.307635 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:08:24.307635 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:08:24.308909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:08:24.308909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:08:24.308909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:08:24.308909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:08:24.308909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 04:08:24.308909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:08:24.308909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 04 04:08:24.308909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 04 04:08:24.308909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:08:24.308909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 04 04:08:24.308909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:08:24.308909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:08:24.308909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:08:24.308909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:08:24.308909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:08:24.308909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 04 04:08:24.308909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: ERROR nova.api.openstack.wsgi Jul 04 04:08:24.308909 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-1b9e45dd-97a1-4dac-bcc6-378b35d0c6c3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103337) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:08:24.310129 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-1b9e45dd-97a1-4dac-bcc6-378b35d0c6c3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011865 Jul 04 04:08:24.310129 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Jul 4 04:08:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 04:08:25.129799 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-b09cd42b-16f8-489e-9605-083d04a04717 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:25.130841 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-b09cd42b-16f8-489e-9605-083d04a04717 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jul 04 04:08:25.131223 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jul 4 04:08:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:08:25.333804 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-1256a270-6cda-4c4f-a17f-508f09126185 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:08:25.355201 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-1256a270-6cda-4c4f-a17f-508f09126185 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.085780 Jul 04 04:08:25.355728 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Jul 4 04:08:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:08:26.195095 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-b09cd42b-16f8-489e-9605-083d04a04717 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:26.196410 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-b09cd42b-16f8-489e-9605-083d04a04717 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002011 Jul 04 04:08:26.196891 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jul 4 04:08:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:08:26.412232 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-fffc73c1-98cc-43fb-aac5-6461d5ff8af4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:08:26.432657 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-fffc73c1-98cc-43fb-aac5-6461d5ff8af4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.088644 Jul 04 04:08:26.433207 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Jul 4 04:08:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:08:27.265932 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-b09cd42b-16f8-489e-9605-083d04a04717 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:27.267021 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-b09cd42b-16f8-489e-9605-083d04a04717 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 04 04:08:27.267386 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jul 4 04:08:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:08:27.469192 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-2649d32d-3131-4cb2-8adc-86a3fb1667d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:08:27.490834 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-2649d32d-3131-4cb2-8adc-86a3fb1667d2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.087296 Jul 04 04:08:27.491378 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Jul 4 04:08:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:08:28.354915 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-b09cd42b-16f8-489e-9605-083d04a04717 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:28.355930 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-b09cd42b-16f8-489e-9605-083d04a04717 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 04 04:08:28.356323 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jul 4 04:08:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:08:28.565299 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-575fc30d-942e-4dc3-94d7-14304c1f651c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:08:28.589268 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-575fc30d-942e-4dc3-94d7-14304c1f651c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.085206 Jul 04 04:08:28.589816 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Mon Jul 4 04:08:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:08:29.454714 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-b09cd42b-16f8-489e-9605-083d04a04717 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:29.455997 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-b09cd42b-16f8-489e-9605-083d04a04717 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002044 Jul 04 04:08:29.456479 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jul 4 04:08:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:08:29.663648 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-1c98a9a4-3326-4783-9ae3-b4c3eef11d74 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:08:29.684200 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-1c98a9a4-3326-4783-9ae3-b4c3eef11d74 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.092032 Jul 04 04:08:29.684810 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Mon Jul 4 04:08:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:09:16.483610 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-b09cd42b-16f8-489e-9605-083d04a04717 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:09:16.484621 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-b09cd42b-16f8-489e-9605-083d04a04717 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 04 04:09:16.485009 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 930 bytes} [Mon Jul 4 04:09:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:09:16.496466 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:09:16.551692 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-862f0aed-8c16-43e6-89ee-7661f2df1046 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:09:16.577568 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-862f0aed-8c16-43e6-89ee-7661f2df1046 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.086320 Jul 04 04:09:16.578100 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1291 bytes} [Mon Jul 4 04:09:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:09:16.600779 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-da2f76f3-4166-489e-9b85-7ae86ef9b286 admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:09:16.604291 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG dbcounter [-] [103338] Writing DB stats nova_api:SELECT=14 {{(pid=103338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:09:16.609899 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-da2f76f3-4166-489e-9b85-7ae86ef9b286 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012733 Jul 04 04:09:16.610408 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1282 bytes} [Mon Jul 4 04:09:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:09:16.625826 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-e8e240ee-996c-4862-9e3a-2fad5a5f5cf2 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:09:16.634123 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-e8e240ee-996c-4862-9e3a-2fad5a5f5cf2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011803 Jul 04 04:09:16.634786 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1285 bytes} [Mon Jul 4 04:09:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:09:16.646687 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-314f6271-2278-4267-a2b9-3100c9d2fc0c admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:09:16.655034 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-314f6271-2278-4267-a2b9-3100c9d2fc0c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011959 Jul 04 04:09:16.655559 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1285 bytes} [Mon Jul 4 04:09:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:09:16.667271 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-db93a20e-8fef-4362-8ef2-0d852832d981 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:09:16.674927 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-db93a20e-8fef-4362-8ef2-0d852832d981 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011498 Jul 04 04:09:16.675434 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1282 bytes} [Mon Jul 4 04:09:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:12:31.691850 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-314f6271-2278-4267-a2b9-3100c9d2fc0c admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:12:31.693377 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-314f6271-2278-4267-a2b9-3100c9d2fc0c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002245 Jul 04 04:12:31.693890 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jul 4 04:12:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:12:31.844822 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_api:SELECT=6 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:31.975229 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-ae86504d-703b-42d0-a7d1-bd72c4bed758 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:12:31.977397 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:12:31.977397 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: warnings.warn(msg) Jul 04 04:12:31.979325 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-ae86504d-703b-42d0-a7d1-bd72c4bed758 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:12:31.980078 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-ae86504d-703b-42d0-a7d1-bd72c4bed758 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:12:31.982085 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-ae86504d-703b-42d0-a7d1-bd72c4bed758 admin admin] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:12:31.982818 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-ae86504d-703b-42d0-a7d1-bd72c4bed758 admin admin] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:12:32.021562 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-ae86504d-703b-42d0-a7d1-bd72c4bed758 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.179188 Jul 04 04:12:32.022108 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Jul 4 04:12:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:12:32.884891 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-314f6271-2278-4267-a2b9-3100c9d2fc0c admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:12:32.885904 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-314f6271-2278-4267-a2b9-3100c9d2fc0c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 04 04:12:32.886295 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jul 4 04:12:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:12:33.080691 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-aa1d4f7c-9c89-4132-a268-e23f959861dc admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:12:33.081953 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:12:33.081953 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: warnings.warn(msg) Jul 04 04:12:33.083287 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-aa1d4f7c-9c89-4132-a268-e23f959861dc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:12:33.083728 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-aa1d4f7c-9c89-4132-a268-e23f959861dc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:12:33.084526 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-aa1d4f7c-9c89-4132-a268-e23f959861dc admin admin] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:12:33.084944 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-aa1d4f7c-9c89-4132-a268-e23f959861dc admin admin] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:12:33.103882 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-aa1d4f7c-9c89-4132-a268-e23f959861dc admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077954 Jul 04 04:12:33.104416 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Jul 4 04:12:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:12:44.377632 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-314f6271-2278-4267-a2b9-3100c9d2fc0c admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:12:44.378708 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-314f6271-2278-4267-a2b9-3100c9d2fc0c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 04 04:12:44.379121 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jul 4 04:12:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:12:44.524715 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_cell0:SELECT=4 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:44.525432 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_cell1:SELECT=4 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:44.526070 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG dbcounter [-] [103337] Writing DB stats nova_api:SELECT=8 {{(pid=103337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:44.583050 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-77ddc0b1-815a-4083-909d-af22a5121479 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:12:44.584205 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:12:44.584205 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: warnings.warn(msg) Jul 04 04:12:44.585342 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-77ddc0b1-815a-4083-909d-af22a5121479 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:12:44.585795 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-77ddc0b1-815a-4083-909d-af22a5121479 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:12:44.586588 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-77ddc0b1-815a-4083-909d-af22a5121479 admin admin] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:12:44.587005 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-77ddc0b1-815a-4083-909d-af22a5121479 admin admin] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:12:44.611838 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-77ddc0b1-815a-4083-909d-af22a5121479 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091549 Jul 04 04:12:44.612374 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 38/74] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Jul 4 04:12:44 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:12:45.458634 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: DEBUG nova.api.openstack.wsgi [None req-314f6271-2278-4267-a2b9-3100c9d2fc0c admin admin] Calling method '>' {{(pid=103338) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:12:45.459911 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: INFO nova.api.openstack.requestlog [None req-314f6271-2278-4267-a2b9-3100c9d2fc0c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Jul 04 04:12:45.460403 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: [pid: 103338|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1074 bytes} [Mon Jul 4 04:12:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:12:45.669630 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG nova.api.openstack.wsgi [None req-9e43827c-b6c4-4bf0-99e2-9f95b8092a71 admin admin] Calling method '>' {{(pid=103337) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:12:45.670825 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:12:45.670825 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: warnings.warn(msg) Jul 04 04:12:45.672056 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-9e43827c-b6c4-4bf0-99e2-9f95b8092a71 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:12:45.672491 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-9e43827c-b6c4-4bf0-99e2-9f95b8092a71 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:12:45.673252 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-9e43827c-b6c4-4bf0-99e2-9f95b8092a71 admin admin] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:12:45.673648 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: DEBUG oslo_concurrency.lockutils [None req-9e43827c-b6c4-4bf0-99e2-9f95b8092a71 admin admin] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103337) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:12:45.695567 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: INFO nova.api.openstack.requestlog [None req-9e43827c-b6c4-4bf0-99e2-9f95b8092a71 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.095123 Jul 04 04:12:45.696126 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: [pid: 103337|app: 0|req: 39/76] 10.222.0.16 () {60 vars in 1193 bytes} [Mon Jul 4 04:12:45 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:13:41.351346 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: Mon Jul 4 04:13:41 2022 - graceful shutdown triggered... Jul 04 04:13:41.351432 dv-cinder-742162-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 04 04:13:41.352386 dv-cinder-742162-5-iscsi devstack@n-api.service[103337]: Gracefully killing worker 1 (pid: 103337)... Jul 04 04:13:41.352815 dv-cinder-742162-5-iscsi devstack@n-api.service[103338]: Gracefully killing worker 2 (pid: 103338)... Jul 04 04:13:42.353682 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: worker 1 buried after 1 seconds Jul 04 04:13:42.353682 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: worker 2 buried after 1 seconds Jul 04 04:13:42.353682 dv-cinder-742162-5-iscsi devstack@n-api.service[103336]: goodbye to uWSGI. Jul 04 04:13:42.356371 dv-cinder-742162-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 04 04:13:42.357270 dv-cinder-742162-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 04 04:13:42.361830 dv-cinder-742162-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 04 04:13:42.377252 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 04 04:13:42.379328 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 4 04:13:42 2022] *** Jul 04 04:13:42.379328 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 04 04:13:42.379328 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 04 04:13:42.379328 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: nodename: dv-cinder-742162-5-iscsi Jul 04 04:13:42.379328 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: machine: x86_64 Jul 04 04:13:42.379328 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: clock source: unix Jul 04 04:13:42.379328 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: pcre jit disabled Jul 04 04:13:42.379328 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: detected number of CPU cores: 4 Jul 04 04:13:42.379328 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: current working directory: / Jul 04 04:13:42.379328 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: detected binary path: /usr/bin/uwsgi-core Jul 04 04:13:42.379328 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: your processes number limit is 47680 Jul 04 04:13:42.380163 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: your memory page size is 4096 bytes Jul 04 04:13:42.380163 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: detected max file descriptor number: 2048 Jul 04 04:13:42.380163 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: lock engine: pthread robust mutexes Jul 04 04:13:42.380163 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: thunder lock: enabled Jul 04 04:13:42.380163 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 04 04:13:42.380163 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 04 04:13:42.424078 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: Python main interpreter initialized at 0x559b4d94f9c0 Jul 04 04:13:42.424078 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: python threads support enabled Jul 04 04:13:42.424078 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: your server socket listen backlog is limited to 100 connections Jul 04 04:13:42.424078 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: your mercy for graceful operations on workers is 90 seconds Jul 04 04:13:42.424578 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: mapped 403077 bytes (393 KB) for 2 cores Jul 04 04:13:42.424578 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: *** Operational MODE: preforking *** Jul 04 04:13:42.424835 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: *** uWSGI is running in multiple interpreter mode *** Jul 04 04:13:42.424835 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: spawned uWSGI master process (pid: 117859) Jul 04 04:13:42.425097 dv-cinder-742162-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 04 04:13:42.425644 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: spawned uWSGI worker 1 (pid: 117875, cores: 1) Jul 04 04:13:42.426162 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: spawned uWSGI worker 2 (pid: 117877, cores: 1) Jul 04 04:13:42.426526 dv-cinder-742162-5-iscsi devstack@n-api.service[117859]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 04 04:13:43.079160 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 04:13:43.079813 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 04:13:44.262311 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 04:13:44.262311 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: from cryptography.utils import int_from_bytes Jul 04 04:13:44.263143 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 04:13:44.263143 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: from cryptography.utils import int_from_bytes Jul 04 04:13:44.263897 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 04:13:44.263897 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: from cryptography.utils import int_from_bytes Jul 04 04:13:44.264041 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 04:13:44.264041 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: from cryptography.utils import int_from_bytes Jul 04 04:13:46.620260 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 04:13:46.620970 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 04:13:46.621060 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 04:13:46.621422 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 04:13:46.621651 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 04:13:46.622071 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.622412 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.622741 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.623062 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.625334 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.625334 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.625334 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.625334 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.625334 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.625334 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.625334 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.625814 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-742162-5-iscsi {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.625814 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.626200 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.626422 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.626705 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.627278 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.627959 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.627959 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.628485 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.629895 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 04:13:46.630350 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.630479 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 04:13:46.630556 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.630556 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.630700 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 04:13:46.630779 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.630849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 04:13:46.630933 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.631006 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 04:13:46.631082 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.631159 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.631230 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.631312 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.631390 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.631719 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.631946 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.632177 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.632396 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.632618 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.632618 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.633010 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-742162-5-iscsi {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.633228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.634259 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.634495 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.634727 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.634951 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.635178 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.635395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.635607 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.635815 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.635963 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.636106 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-742162-5-iscsi {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.636263 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.636414 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.636556 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.636653 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.636738 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.636828 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.636911 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.637025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.637176 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.637312 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.637453 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.637598 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.637748 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.637901 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.638046 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.638191 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.638674 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.638829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.639016 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.639151 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.639297 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.639473 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.639622 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.639773 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.639929 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.640082 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.640224 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.640224 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.640493 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.640648 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.640799 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.640947 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.641096 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.641096 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.641359 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.641509 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.641690 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.641690 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.641971 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-742162-5-iscsi {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.642113 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.642332 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.642468 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.642602 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.642736 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.643255 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.643361 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.643469 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.643564 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.643656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.643741 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.643824 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.643921 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.643921 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.644092 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.644092 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.644264 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.644348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.644445 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.644530 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.644619 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.644703 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.644794 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.644887 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.644980 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.645075 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.645165 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.645253 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.645397 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.645532 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.645675 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.645810 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.645936 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.646030 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.646114 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.646206 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.646299 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.646448 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.646589 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.646693 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.646786 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.646885 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.647011 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.647146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.647388 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.647526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.647644 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.647957 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.650412 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.650547 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.650661 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.650751 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.650838 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.650920 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.651001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.651072 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.651153 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.651225 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.651306 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.651378 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.651454 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.651535 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.651617 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.651697 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.651776 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.651859 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.651931 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.652000 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.652069 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.652152 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.652152 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.652280 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.652353 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.652423 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.652498 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.652577 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.652656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.652727 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.652806 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.652884 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.653333 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.653442 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.653554 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.653633 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.653705 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.653780 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.653965 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.654080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.654272 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.654393 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.654631 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.654734 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.654926 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.655021 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.655237 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.655329 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.655545 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.655656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.655855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.656048 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.656207 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.656368 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.656525 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.656686 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.656826 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.656976 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.657123 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.657276 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.657446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.657589 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.657679 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.657828 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.657922 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.658205 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.658352 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.658914 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.659007 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.659007 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.659232 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.659333 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.659427 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.659519 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.659688 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.659788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.660021 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.660114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.660330 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.660432 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.660640 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.660740 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.660943 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.661034 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.661247 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.661340 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.661551 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.661641 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.661855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.661953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.662158 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.662256 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.662487 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.662586 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.662794 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.662896 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.663100 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.663202 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.663410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.663514 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.663711 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.663814 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.664010 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.664100 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.664318 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.664424 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.664623 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.664716 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.664929 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.665032 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.665231 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.665320 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.665538 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.665662 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.665884 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.666019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.666222 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.666347 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.666617 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.666772 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.666933 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.667081 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.667228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.667365 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.667514 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.667677 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.667825 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.667967 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.668120 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.668260 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.668410 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.668609 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.668754 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.668901 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.669046 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.669191 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.669337 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.669491 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.669638 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.669779 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.669925 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.670069 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.670207 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.670482 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.670635 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.670786 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.670930 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.671075 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.671229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.671369 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.671508 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.671646 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.671792 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.671932 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.672086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.672225 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.672373 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.672514 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.672650 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.672794 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.672948 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.673089 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 04:13:46.673228 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.673374 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.673520 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.673734 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.674352 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.674539 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.674709 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.674858 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.675002 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.675139 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.675282 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.675436 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.675606 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.675772 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.675862 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.675956 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.676071 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.676177 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.676323 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.676459 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.676629 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.676746 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.676933 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.677035 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.677244 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.677344 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.677562 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.677679 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.677873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.677979 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.678187 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.678349 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.678609 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.678754 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.678906 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.679050 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.679195 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.679343 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.679492 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.679649 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.679792 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.679931 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.680078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.680225 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.680374 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.680523 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.680675 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.680815 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.680961 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.681106 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.681249 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.681398 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.681539 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.681684 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.681824 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.681969 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.682109 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.682263 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.682450 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.682590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.682763 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.682914 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.683077 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.683266 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.683404 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.683554 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.683692 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.683827 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.684017 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.684152 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.684301 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.684451 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.684598 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.684742 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.684893 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.685038 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.685177 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.685316 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.685462 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.685601 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.685753 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.685913 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.686053 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.686197 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.686343 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.686570 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.686754 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.686998 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.687102 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.687189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.687310 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.687413 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.687619 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.687711 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.687929 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.688043 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.688233 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.688335 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.688535 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.688628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.688837 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.688936 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.689140 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.689242 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.689508 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.689639 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.689804 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.690173 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.690285 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.690516 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.690629 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.690828 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.690964 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.691150 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.691257 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.691456 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.691549 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.691770 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.691863 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.692083 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.692185 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.692393 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.692485 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.692699 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.692798 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.693009 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.693112 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.693317 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.693417 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.693625 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.693724 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.693947 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.694057 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.694251 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.694349 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.694576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.694668 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.694888 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.694981 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.695192 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.695283 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.695493 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.695585 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.695797 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.695940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.696102 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.696198 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.696406 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.696505 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.696710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.696844 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.697019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.697152 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.697323 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.697422 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.697632 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.697732 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.697941 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.698068 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.698270 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.698410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.698607 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.698710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.698911 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.699015 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.699233 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.699340 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.699559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.699677 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.699877 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.699978 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.700177 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.700305 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.700485 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.700576 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.700786 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.700885 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.701087 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.701194 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.701388 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.701490 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.701695 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.701811 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.701995 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.702087 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.702296 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.702417 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.702623 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.702722 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.702922 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.703029 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.703226 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.703384 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.703553 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.703693 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.703844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.703991 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.704155 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.704302 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.704451 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.704598 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.704750 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.704891 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.705260 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.705690 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.705843 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.705995 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.706141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.706289 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.706452 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.706631 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.706773 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.706872 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.707004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.707131 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.707284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.707501 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.707641 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.707779 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.707875 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.707960 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.708068 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.708206 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.708337 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.708517 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.708646 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.708828 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.708960 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.709150 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.709286 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.709461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.709597 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.709779 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.709916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.710090 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.710223 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.710431 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.710556 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.710744 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.710892 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.711208 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.711377 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.711519 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.711658 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.711819 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.711968 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.712141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.712322 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.712483 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.712639 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.712783 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.712934 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.713079 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.713230 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.713387 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.713534 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.713674 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.713822 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.713972 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.714113 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.714252 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.714444 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.714582 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.714739 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.714892 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.715032 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.715178 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.715325 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.715471 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.715619 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.715785 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.715950 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.716100 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.716236 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.716387 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.716586 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.716748 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.716890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.717030 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.717201 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.717335 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.717510 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.717634 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.717822 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.717933 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.718148 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.718240 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.718493 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.718601 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.718804 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.718904 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.719114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.719207 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.719420 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.719511 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.719728 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.719819 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.720036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.720134 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.720345 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.720441 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.720725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.720832 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.721033 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.721126 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.721344 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.721434 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.721659 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.721757 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.721970 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.722070 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.722280 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.722405 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.722609 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.722712 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.722925 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.723031 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.723236 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.723327 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.723544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.723646 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.723848 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.724020 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.724158 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.724260 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.724477 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.724569 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.724784 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.724888 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.725104 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.725196 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.725424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.725518 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.725725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.725825 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.726028 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.726141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.726351 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.726487 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.726677 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.726853 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.726981 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.727071 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.727287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.727459 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.727646 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.727872 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.727968 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.728212 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.728302 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.728518 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.728703 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.728857 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.729005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.729146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.729293 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.729445 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.729587 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.729733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.729880 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.730061 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.730207 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.730357 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.730538 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.730706 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.730857 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.731005 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.731145 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.731292 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.731437 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.731578 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.731726 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.731866 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.732004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.732143 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.732281 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.732455 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.732610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.732777 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.732926 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.733088 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.733228 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.733404 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.733562 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.733699 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.733837 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.733983 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.734134 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.734362 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.734559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.734703 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.734793 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.734916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.735186 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.735289 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.735518 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.735618 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.735832 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.735933 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.736143 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.736284 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.736685 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.736798 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.737020 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.737194 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.737390 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.737674 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.737783 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.738013 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.738125 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.738316 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.738439 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.738650 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.738751 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.738955 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.739062 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.739261 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.739355 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.739570 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.739669 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.739872 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.739974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.740173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.740265 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.740477 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.740585 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.740787 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.740879 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.741090 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.741182 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.741393 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.741484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.741694 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.741787 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.741999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.742097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.742312 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.742498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.742639 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.742741 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.742954 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.743083 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.743264 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.743432 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.743620 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.743755 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.743867 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.743960 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.744167 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.744268 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.744468 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.744559 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.744771 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.744872 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.745076 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.745176 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.745384 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.745485 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.745702 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.745876 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.746025 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.746239 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.746332 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.746445 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.746635 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.746752 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.746941 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.747044 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.747262 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.747363 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.747573 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.747700 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.747875 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.747980 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.748173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.748268 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.748480 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.748572 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.748787 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.748880 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.749089 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.749182 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.749399 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.749490 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.749710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.749805 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.750014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.750103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.750317 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.750433 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.750640 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.750742 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.750948 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.751042 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.751252 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.751351 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.751562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.751654 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.751920 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.752024 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.752223 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.752330 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.752563 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.752682 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.752818 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.752917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.753124 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.753225 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.753430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.753528 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.753741 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.753910 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.754069 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.754230 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.754421 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.754574 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.754714 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.754810 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.754936 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.755037 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.755237 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.755336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.755542 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.755634 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.755847 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.755946 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.756149 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.756250 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.756451 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.756550 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.756757 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.756866 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.757060 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.757154 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.757373 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.757465 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.757682 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.757774 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.757988 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.758163 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.758305 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.758430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.758629 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.758722 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.758954 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.759059 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.759265 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.759369 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.759566 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.759685 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.759877 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.759980 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.760179 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.760305 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.760482 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.760577 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.760783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.760875 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.761090 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.761197 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.761390 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.761481 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.761691 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.761790 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.761988 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.762093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.762288 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.762408 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.762611 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.762715 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.762930 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.763033 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.763243 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.763651 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.763856 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.763957 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.764157 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.764261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.764458 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.764549 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.764772 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.764862 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.765085 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.765184 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.765397 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.765489 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.765710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.765810 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.766022 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.766123 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.766335 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.766458 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.766673 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.766773 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.766980 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.767081 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.767291 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.767390 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.767691 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.768211 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.768313 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.768404 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.768611 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.768714 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.768801 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.768896 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.769051 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.769144 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.769230 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.769323 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.769419 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.769519 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.769697 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.769789 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.770005 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.770097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.770325 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.770447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.770684 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.770786 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.771008 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.771156 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.771310 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.771473 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.771618 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.771787 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.771925 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.772098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.772232 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.772414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.772538 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.772729 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.772845 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.773051 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.773156 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.773369 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.773469 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.773677 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.773775 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.774042 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.774134 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.774352 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.774480 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.774677 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.774782 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.774986 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.775081 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.775297 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.775397 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.775603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.775702 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.775915 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.776059 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.776211 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.776352 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.776521 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.776800 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.776980 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.777168 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.777315 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.777480 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.777700 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.777919 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.778308 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.778503 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.778599 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.778773 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.779008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.779129 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.779366 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.779609 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.779711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.779976 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.780289 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.780393 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.780604 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.780933 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.781163 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.781409 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.781636 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.781861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.782087 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.782314 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.782653 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.782885 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.782885 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.783674 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.783848 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.784063 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.784277 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.784490 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.784736 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.784958 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.784958 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.785391 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.785621 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.785621 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.786042 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.786257 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.786427 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.786646 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.786646 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.787058 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.787266 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.787499 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.787742 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.787909 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.788053 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.788229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.788344 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.788344 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.788600 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.788742 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.788910 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.789050 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.789138 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.789138 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.789371 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.789467 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.789554 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.789685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.789785 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.789997 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.790097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.790317 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.790451 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.790657 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.790807 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.790987 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.791083 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.791317 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.791411 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.791629 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.791727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.791948 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.792057 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.792252 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.792352 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.792577 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.792675 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.792894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.793000 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.793209 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.793309 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.793526 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.793624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.793838 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.793940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.794153 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.794256 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.794505 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.794616 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.794819 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.794926 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.795150 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.795242 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.795471 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.795564 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.795776 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.795880 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.796088 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.796187 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.796394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.796485 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.796701 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.796801 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.797026 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.797116 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.797329 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.797422 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.797638 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.797763 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.797952 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.798070 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.798251 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.798439 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.798609 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.798728 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.799217 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.799438 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.799531 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.799615 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.799785 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.799875 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.800049 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.800150 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.800387 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.800498 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.800709 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.800809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.801031 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.801122 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.801335 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.801440 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.801661 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.801756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.801975 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.802076 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.802280 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.802409 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.802608 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.802715 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.802915 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.803007 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.803227 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.803347 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.803540 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.803665 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.803855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.803982 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.804164 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.804267 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.804472 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.804566 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.804778 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.804871 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.805107 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.805210 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.805420 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.805523 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.805737 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.805829 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.806056 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.806148 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.806415 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.806512 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.806699 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.806791 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.807002 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.807102 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.807316 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.807408 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.807622 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.807723 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.807929 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.808030 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.808234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.808327 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.808544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.808648 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.808851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.808994 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.809158 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.809306 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.809461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.809566 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.809783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.809877 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.810088 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.810189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.810431 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.810541 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.810745 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.810839 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.811052 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.811147 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.811360 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.811462 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.811664 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.811756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.812008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.812104 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.812311 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.812403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.812635 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.812727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.812949 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.813040 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.813271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.813500 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.813599 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.813831 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.813923 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.814152 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.814258 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.814602 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.815134 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.815235 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.815322 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.815467 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.815467 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.815639 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.815791 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.815885 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.816105 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.816213 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.816420 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.816513 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.816735 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.816833 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.817050 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.817153 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.817370 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.817460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.817700 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.817793 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.818038 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.818130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.818358 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.818648 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.818759 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.818977 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.819080 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.819295 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.819396 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.819609 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.819712 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.819925 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.820035 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.820238 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.820330 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.820551 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.820650 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.820863 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.820965 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.821176 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.821327 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.821475 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.821617 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.821773 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.821921 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.822093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.822235 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.822429 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.822579 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.822732 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.822880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.823045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.823187 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.823361 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.823508 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.823678 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.823782 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.823990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.824098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.824339 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.824502 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.824627 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.824711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.824965 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.825107 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.825293 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.825434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.825560 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.825644 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.825892 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.826113 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.826274 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.826407 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.826513 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.826773 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.826915 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.827108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.827268 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.827366 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.827453 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.827688 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.827786 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.827994 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.828106 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.828305 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.828403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.828603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.828774 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.829003 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.829160 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.829305 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.829403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.829564 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.829712 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.829858 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.830023 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.830644 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.830742 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.830828 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.830913 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.831013 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.831101 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.831230 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.831386 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.831479 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.831790 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.831930 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.832116 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.832285 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.832441 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.832604 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.832757 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.832933 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.833073 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.833262 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.833407 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.833582 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.833712 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.833893 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.834014 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.834222 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.834324 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.834563 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.834697 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.834877 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.835009 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.835199 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.835303 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.835516 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.835618 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.835822 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.835931 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.836127 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.836234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.836436 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.836538 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.836746 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.836969 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.837078 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.837319 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.837431 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.837634 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.837743 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.837961 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.838067 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.838270 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.838401 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.838604 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.838736 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.838911 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.839019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.839225 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.839319 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.839533 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.839645 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.839833 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.839937 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.840137 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.840251 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.840444 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.840537 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.840746 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.840839 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.841049 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.841140 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.841360 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.841462 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.841670 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.841765 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.841977 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.842079 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.842279 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.842397 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.842604 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.842714 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.842930 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.843022 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.843237 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.843328 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.843548 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.843654 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.843856 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.843957 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.844657 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.844778 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.844875 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.844972 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.845065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.845139 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.845209 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.845287 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.845368 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.845454 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.845717 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.845943 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.846063 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.846191 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.846440 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.846732 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.846826 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.847051 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.847170 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.847355 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.847463 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.847667 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.847768 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.848018 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.848119 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.848329 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.848437 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.848635 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.848733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.848937 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.849039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.849249 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.849383 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.849572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.849715 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.849890 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.850016 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.850179 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.850273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.850511 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.850606 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.850824 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.850927 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.851141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.851235 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.851463 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.851674 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.851768 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.852009 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.852116 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.852330 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.852430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.852661 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.852754 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.852973 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.853068 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.853289 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.853426 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.853591 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.853692 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.853893 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.853987 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.854219 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.854323 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.854556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.854651 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.854866 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.854961 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.855175 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.855275 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.855489 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.855592 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.855795 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.855888 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.856107 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.856198 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.856416 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.856516 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.856723 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.856823 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.857031 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.857125 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.857341 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.857447 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.857647 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.857747 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.857951 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.858163 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.858256 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.858508 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.858606 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.858836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.858947 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.859162 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.859272 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.859528 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.859647 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.859805 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.859900 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.860116 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.860257 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.860427 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.860527 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.860737 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.860837 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.861049 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.861154 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.861398 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.861512 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.861717 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.861819 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.862105 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.862215 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.862457 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.862567 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.862769 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.862864 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.863078 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.863290 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.863384 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.863612 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.863714 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.863934 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.864042 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.864258 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.864360 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.864571 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.864664 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.864875 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.864982 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.865188 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.865325 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.865496 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.865588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.865805 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.865941 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.866112 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.866237 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.866442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.866536 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.866760 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.866854 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.867066 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.867158 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.867372 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.867473 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.867678 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.867779 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.867983 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.868083 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.868286 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.868390 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.868587 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.868685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.868900 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.868992 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.869205 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.869327 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.869506 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.869649 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.869807 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.869899 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.870114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.870264 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.870435 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.870542 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.870742 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.870834 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.871048 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.871143 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.871355 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.871446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.874410 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.874534 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.874640 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.874720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.874802 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.874884 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.874964 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.875037 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.875118 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.875200 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.875292 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.875376 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.875456 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.875528 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.875608 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.875680 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.875750 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.875820 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.875898 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.875979 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.876106 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.876182 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.876274 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.876370 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.876444 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.876529 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.876604 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.876675 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.876745 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.876865 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.877366 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.877478 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.877563 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.877644 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.877716 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.877787 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.877787 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.877930 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.878010 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.878091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.878169 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.878241 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.878320 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.878429 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.878506 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.878736 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.878828 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.878909 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.879398 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.879513 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.879601 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.879703 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.879797 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.880023 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.880182 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.880334 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.880451 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.880684 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.880793 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.880980 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.881091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.881346 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.881450 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.881628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.881729 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.881932 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.882060 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.882289 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.882463 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.882614 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.882708 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.882967 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.883101 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.883387 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.883535 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.883746 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.883872 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.883998 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.884181 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.884294 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.884413 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.884523 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.884697 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.884879 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.885066 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.885224 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 04:13:46.885410 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.885762 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.886152 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.886530 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.886879 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.887176 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.887531 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.887815 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.888136 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.888768 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.889118 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.889430 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.889771 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.890099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.890429 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.890741 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.891043 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 04:13:46.891286 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 04:13:46.947694 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO dbcounter [None req-42fe2af4-dc1c-430c-bdb6-172286afd68b None None] Registered counter for database nova_api Jul 04 04:13:46.953673 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO dbcounter [None req-d9b573f7-b3d1-442f-9b2f-1c442db50e89 None None] Registered counter for database nova_api Jul 04 04:13:46.968226 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_db.sqlalchemy.engines [None req-42fe2af4-dc1c-430c-bdb6-172286afd68b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 04:13:46.974219 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_db.sqlalchemy.engines [None req-d9b573f7-b3d1-442f-9b2f-1c442db50e89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 04:13:46.976001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writer thread running {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 04:13:46.981287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writer thread running {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 04:13:47.032303 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.context [None req-42fe2af4-dc1c-430c-bdb6-172286afd68b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0ce0899c-f5f4-4daa-b092-f0b42011e739(cell1) {{(pid=117875) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 04:13:47.036480 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-42fe2af4-dc1c-430c-bdb6-172286afd68b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:13:47.037910 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.context [None req-d9b573f7-b3d1-442f-9b2f-1c442db50e89 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0ce0899c-f5f4-4daa-b092-f0b42011e739(cell1) {{(pid=117877) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 04:13:47.038054 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-42fe2af4-dc1c-430c-bdb6-172286afd68b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:13:47.038879 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-42fe2af4-dc1c-430c-bdb6-172286afd68b None None] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:13:47.040836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-42fe2af4-dc1c-430c-bdb6-172286afd68b None None] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:13:47.042186 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9b573f7-b3d1-442f-9b2f-1c442db50e89 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:13:47.042875 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO dbcounter [None req-42fe2af4-dc1c-430c-bdb6-172286afd68b None None] Registered counter for database nova_cell0 Jul 04 04:13:47.043954 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9b573f7-b3d1-442f-9b2f-1c442db50e89 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:13:47.048779 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9b573f7-b3d1-442f-9b2f-1c442db50e89 None None] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:13:47.048941 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO dbcounter [None req-42fe2af4-dc1c-430c-bdb6-172286afd68b None None] Registered counter for database nova_cell1 Jul 04 04:13:47.049046 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9b573f7-b3d1-442f-9b2f-1c442db50e89 None None] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:13:47.049379 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO dbcounter [None req-d9b573f7-b3d1-442f-9b2f-1c442db50e89 None None] Registered counter for database nova_cell0 Jul 04 04:13:47.053415 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO dbcounter [None req-d9b573f7-b3d1-442f-9b2f-1c442db50e89 None None] Registered counter for database nova_cell1 Jul 04 04:13:47.055421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_db.sqlalchemy.engines [None req-42fe2af4-dc1c-430c-bdb6-172286afd68b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 04:13:47.058142 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_db.sqlalchemy.engines [None req-42fe2af4-dc1c-430c-bdb6-172286afd68b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 04:13:47.060852 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_db.sqlalchemy.engines [None req-d9b573f7-b3d1-442f-9b2f-1c442db50e89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 04:13:47.061832 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writer thread running {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 04:13:47.062572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_db.sqlalchemy.engines [None req-d9b573f7-b3d1-442f-9b2f-1c442db50e89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 04:13:47.068530 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writer thread running {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 04:13:47.070285 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writer thread running {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 04:13:47.201354 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writer thread running {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 04:13:47.211163 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO dbcounter [None req-42fe2af4-dc1c-430c-bdb6-172286afd68b None None] Registered counter for database nova_cell0 Jul 04 04:13:47.218268 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_db.sqlalchemy.engines [None req-42fe2af4-dc1c-430c-bdb6-172286afd68b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 04:13:47.222146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO dbcounter [None req-d9b573f7-b3d1-442f-9b2f-1c442db50e89 None None] Registered counter for database nova_cell0 Jul 04 04:13:47.223106 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writer thread running {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 04:13:47.231244 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_db.sqlalchemy.engines [None req-d9b573f7-b3d1-442f-9b2f-1c442db50e89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 04:13:47.236166 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writer thread running {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 04:13:47.544605 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: WARNING keystonemiddleware.auth_token [None req-42fe2af4-dc1c-430c-bdb6-172286afd68b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 04:13:47.552382 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: WARNING keystonemiddleware.auth_token [None req-42fe2af4-dc1c-430c-bdb6-172286afd68b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 04:13:47.565732 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: WARNING keystonemiddleware.auth_token [None req-d9b573f7-b3d1-442f-9b2f-1c442db50e89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 04:13:47.573259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: WARNING keystonemiddleware.auth_token [None req-d9b573f7-b3d1-442f-9b2f-1c442db50e89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 04:13:47.899875 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: WARNING keystonemiddleware.auth_token [None req-42fe2af4-dc1c-430c-bdb6-172286afd68b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 04:13:47.905815 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: WARNING keystonemiddleware.auth_token [None req-42fe2af4-dc1c-430c-bdb6-172286afd68b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 04:13:47.911534 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559b4d94f9c0 pid: 117875 (default app) Jul 04 04:13:47.935854 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: WARNING keystonemiddleware.auth_token [None req-d9b573f7-b3d1-442f-9b2f-1c442db50e89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 04:13:47.942405 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: WARNING keystonemiddleware.auth_token [None req-d9b573f7-b3d1-442f-9b2f-1c442db50e89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 04:13:47.947745 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559b4d94f9c0 pid: 117877 (default app) Jul 04 04:14:28.517240 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=3 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:14:28.518780 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=3 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:14:28.521108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=3 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:14:28.522144 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=3 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:14:28.843573 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:14:28.847744 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:14:28.849913 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:14:28.850889 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:14:30.460129 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c5182232-b067-4df1-a899-23683530801c tempest-VolumesGetTestJSON-500488664 tempest-VolumesGetTestJSON-500488664-project] Action: 'create', calling method: .version_select at 0x7f50c308a700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1796929548", "metadata": {"Type": "work"}}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:14:30.675011 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6bc95d3f-3aeb-4a0d-824c-428f81b80d39 tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] Action: 'create', calling method: .version_select at 0x7f50c3089700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-479400890", "metadata": {"Type": "work"}}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6bc95d3f-3aeb-4a0d-824c-428f81b80d39 tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] Request method failure captured: Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 121 Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmkk0CeqfO6lqdBqVRPslvreKGlvXH4MW2ZMDmSSAWJPnm_y_2TUApVvZet9OLbPA6Za4zD6Zy7gp9ufNL1iW2TYKECJY5qB0Ti8zjP81TRobSAWwgDDTt1HPJ55FYkcwEuh5SvAXVkphzzNufNGGWC3aAu08t9izY9pZnLtGm1XWso Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 94810165aeb641848b753c96ca3ad7a8 Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-VolumesNegativeTest-1910246737 Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:14:30.697287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:14:30.698697 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94810165aeb641848b753c96ca3ad7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/94810165aeb641848b753c96ca3ad7a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94810165aeb641848b753c96ca3ad7a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_94810165aeb641848b753c96ca3ad7a8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:14:30.698697 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-VolumesNegativeTest-1910246737 Jul 04 04:14:30.698697 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 94810165aeb641848b753c96ca3ad7a8 Jul 04 04:14:30.698697 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-VolumesNegativeTest-1910246737 Jul 04 04:14:30.698697 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-VolumesNegativeTest-1910246737-project Jul 04 04:14:30.698697 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:14:30.698697 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:14:30.698697 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: 1758d6fed42543fc9ff569b7051cb3e8 Jul 04 04:14:30.698697 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-VolumesNegativeTest-1910246737-project Jul 04 04:14:30.698697 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Jul 04 04:14:30.698697 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-479400890", "metadata": {"Type": "work"}}} Jul 04 04:14:30.698697 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: Jul 04 04:14:30.698697 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-479400890', 'metadata': {'Type': 'work'}}}} Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise error Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi '#$%' Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:14:30.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:14:30.700953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 04:14:30.700953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 04:14:30.700953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:14:30.700953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:14:30.700953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 04 04:14:30.700953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 04 04:14:30.700953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 04 04:14:30.700953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 04 04:14:30.700953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 04 04:14:30.700953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 04 04:14:30.700953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 04 04:14:30.700953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:30.700953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:30.700953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:30.700953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:30.700953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:30.700953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:30.700953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 04 04:14:30.700953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 04 04:14:30.702166 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 04 04:14:30.702166 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:30.706466 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6bc95d3f-3aeb-4a0d-824c-428f81b80d39 tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:14:30.707682 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6bc95d3f-3aeb-4a0d-824c-428f81b80d39 tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.875041 Jul 04 04:14:30.717482 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1155 bytes} [Mon Jul 4 04:14:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1886 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 04:14:31.033080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c9b85268-f586-43c1-90f8-15c2af16bb6d tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Action: 'create', calling method: .version_select at 0x7f50c300c9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1124861478"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:14:32.640817 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c5182232-b067-4df1-a899-23683530801c tempest-VolumesGetTestJSON-500488664 tempest-VolumesGetTestJSON-500488664-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.153971 Jul 04 04:14:32.641899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 1/2] 10.222.0.16 () {60 vars in 1155 bytes} [Mon Jul 4 04:14:28 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4157 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 04 04:14:32.647884 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-4b44553e-09e7-492d-bc29-eb9f57857516 tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] Action: 'create', calling method: .version_select at 0x7f50c2f4f4c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2055287131", "metadata": {"Type": "work"}}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-4b44553e-09e7-492d-bc29-eb9f57857516 tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] Request method failure captured: Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 120 Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmkk0CeqfO6lqdBqVRPslvreKGlvXH4MW2ZMDmSSAWJPnm_y_2TUApVvZet9OLbPA6Za4zD6Zy7gp9ufNL1iW2TYKECJY5qB0Ti8zjP81TRobSAWwgDDTt1HPJ55FYkcwEuh5SvAXVkphzzNufNGGWC3aAu08t9izY9pZnLtGm1XWso Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: 94810165aeb641848b753c96ca3ad7a8 Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-VolumesNegativeTest-1910246737 Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:14:32.667720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:14:32.669158 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94810165aeb641848b753c96ca3ad7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/94810165aeb641848b753c96ca3ad7a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94810165aeb641848b753c96ca3ad7a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_94810165aeb641848b753c96ca3ad7a8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:14:32.669158 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-VolumesNegativeTest-1910246737 Jul 04 04:14:32.669158 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: 94810165aeb641848b753c96ca3ad7a8 Jul 04 04:14:32.669158 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-VolumesNegativeTest-1910246737 Jul 04 04:14:32.669158 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-VolumesNegativeTest-1910246737-project Jul 04 04:14:32.669158 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:14:32.669158 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:14:32.669158 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 1758d6fed42543fc9ff569b7051cb3e8 Jul 04 04:14:32.669158 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-VolumesNegativeTest-1910246737-project Jul 04 04:14:32.669158 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Jul 04 04:14:32.669158 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2055287131", "metadata": {"Type": "work"}}} Jul 04 04:14:32.669158 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: Jul 04 04:14:32.669158 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2055287131', 'metadata': {'Type': 'work'}}}} Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise error Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi '0' Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:14:32.669944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:14:32.671403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 04:14:32.671403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 04:14:32.671403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:14:32.671403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:14:32.671403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 04 04:14:32.671403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 04 04:14:32.671403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 04 04:14:32.671403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 04 04:14:32.671403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 04 04:14:32.671403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 04 04:14:32.671403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 04 04:14:32.671403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:32.671403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:32.671403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:32.671403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:32.671403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:32.671403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:32.671403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 04 04:14:32.671403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 04 04:14:32.672528 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 04 04:14:32.672528 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:32.672528 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-4b44553e-09e7-492d-bc29-eb9f57857516 tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:14:32.672528 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-4b44553e-09e7-492d-bc29-eb9f57857516 tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.026258 Jul 04 04:14:32.682466 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1155 bytes} [Mon Jul 4 04:14:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 04:14:32.696178 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9365a577-822c-40e3-abf6-2f288e11917a tempest-VolumesGetTestJSON-500488664 tempest-VolumesGetTestJSON-500488664-project] Calling method '.version_select at 0x7f50c2f4f4c0>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:32.933149 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9365a577-822c-40e3-abf6-2f288e11917a tempest-VolumesGetTestJSON-500488664 tempest-VolumesGetTestJSON-500488664-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/92aa56d3-a928-48b1-a2b7-ec8c25e79def" status: 200 len: 353 microversion: 2.1 time: 0.249063 Jul 04 04:14:32.933723 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 3/4] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jul 4 04:14:32 2022] GET /compute/v2.1/os-volumes/92aa56d3-a928-48b1-a2b7-ec8c25e79def => generated 353 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:14:32.938936 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e0f9aef3-eca6-4f19-ac35-7369b4f8a1fe tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] Action: 'create', calling method: .version_select at 0x7f50c2f4f310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-856162474", "metadata": {"Type": "work"}}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e0f9aef3-eca6-4f19-ac35-7369b4f8a1fe tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] Request method failure captured: Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 118 Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmkk0CeqfO6lqdBqVRPslvreKGlvXH4MW2ZMDmSSAWJPnm_y_2TUApVvZet9OLbPA6Za4zD6Zy7gp9ufNL1iW2TYKECJY5qB0Ti8zjP81TRobSAWwgDDTt1HPJ55FYkcwEuh5SvAXVkphzzNufNGGWC3aAu08t9izY9pZnLtGm1XWso Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: 94810165aeb641848b753c96ca3ad7a8 Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-VolumesNegativeTest-1910246737 Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:14:32.943048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:14:32.944443 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94810165aeb641848b753c96ca3ad7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/94810165aeb641848b753c96ca3ad7a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94810165aeb641848b753c96ca3ad7a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_94810165aeb641848b753c96ca3ad7a8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:14:32.944443 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-VolumesNegativeTest-1910246737 Jul 04 04:14:32.944443 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: 94810165aeb641848b753c96ca3ad7a8 Jul 04 04:14:32.944443 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-VolumesNegativeTest-1910246737 Jul 04 04:14:32.944443 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-VolumesNegativeTest-1910246737-project Jul 04 04:14:32.944443 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:14:32.944443 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:14:32.944443 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 1758d6fed42543fc9ff569b7051cb3e8 Jul 04 04:14:32.944443 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-VolumesNegativeTest-1910246737-project Jul 04 04:14:32.944443 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Jul 04 04:14:32.944443 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-856162474", "metadata": {"Type": "work"}}} Jul 04 04:14:32.944443 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: Jul 04 04:14:32.944443 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-856162474', 'metadata': {'Type': 'work'}}}} Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise error Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi '' Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:14:32.948189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:14:32.952855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 04:14:32.952855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 04:14:32.952855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:14:32.952855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:14:32.952855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 04 04:14:32.952855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 04 04:14:32.952855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 04 04:14:32.952855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 04 04:14:32.952855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 04 04:14:32.952855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 04 04:14:32.952855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 04 04:14:32.952855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:32.952855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:32.952855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:32.952855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:32.952855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:32.952855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:32.952855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 04 04:14:32.952855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 04 04:14:32.954056 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 04 04:14:32.954056 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:32.954056 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e0f9aef3-eca6-4f19-ac35-7369b4f8a1fe tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:14:32.954056 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e0f9aef3-eca6-4f19-ac35-7369b4f8a1fe tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011548 Jul 04 04:14:32.954056 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 4/5] 10.222.0.16 () {60 vars in 1155 bytes} [Mon Jul 4 04:14:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 04:14:32.981877 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-0619684a-afb9-4b67-89c6-0c98da6fafd1 tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] Calling method '.version_select at 0x7f50c2f04f70>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:33.147540 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-0619684a-afb9-4b67-89c6-0c98da6fafd1 tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] HTTP exception thrown: Volume tempest-invalid-1802058213 could not be found. Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-0619684a-afb9-4b67-89c6-0c98da6fafd1 tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] Request method failure captured: Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1802058213 HTTP/1.1 Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmkk0CeqfO6lqdBqVRPslvreKGlvXH4MW2ZMDmSSAWJPnm_y_2TUApVvZet9OLbPA6Za4zD6Zy7gp9ufNL1iW2TYKECJY5qB0Ti8zjP81TRobSAWwgDDTt1HPJ55FYkcwEuh5SvAXVkphzzNufNGGWC3aAu08t9izY9pZnLtGm1XWso Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: 94810165aeb641848b753c96ca3ad7a8 Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-VolumesNegativeTest-1910246737 Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:14:33.151718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:14:33.153130 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94810165aeb641848b753c96ca3ad7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/94810165aeb641848b753c96ca3ad7a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94810165aeb641848b753c96ca3ad7a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_94810165aeb641848b753c96ca3ad7a8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:14:33.153130 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-VolumesNegativeTest-1910246737 Jul 04 04:14:33.153130 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: 94810165aeb641848b753c96ca3ad7a8 Jul 04 04:14:33.153130 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-VolumesNegativeTest-1910246737 Jul 04 04:14:33.153130 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-VolumesNegativeTest-1910246737-project Jul 04 04:14:33.153130 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:14:33.153130 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:14:33.153130 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 1758d6fed42543fc9ff569b7051cb3e8 Jul 04 04:14:33.153130 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-VolumesNegativeTest-1910246737-project Jul 04 04:14:33.153130 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: Jul 04 04:14:33.153130 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Volume tempest-invalid-1802058213 could not be found. Jul 04 04:14:33.153130 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': 'tempest-invalid-1802058213'} Jul 04 04:14:33.153130 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:14:33.153951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:33.153951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 04:14:33.153951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 04:14:33.153951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 04:14:33.153951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 04:14:33.153951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 04:14:33.153951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 04:14:33.153951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 04:14:33.153951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 04:14:33.153951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 04:14:33.153951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 04:14:33.153951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 04:14:33.153951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 04:14:33.153951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 04:14:33.153951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 04:14:33.153951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1802058213 could not be found. (HTTP 404) (Request-ID: req-bc757f79-7207-4006-bca4-7c9cbd54185f) Jul 04 04:14:33.153951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.153951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:33.153951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.155181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:33.155181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 04 04:14:33.155181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 04 04:14:33.155181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 04:14:33.155181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 04:14:33.155181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 04:14:33.155181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 04:14:33.155181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 04:14:33.155181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 04:14:33.155181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 04:14:33.155181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 04:14:33.155181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 04:14:33.155181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 04:14:33.155181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 04:14:33.155181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 04:14:33.155181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 04:14:33.155181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 04:14:33.155181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 04:14:33.155181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1802058213 could not be found. Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:14:33.156273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1802058213 could not be found. Jul 04 04:14:33.157421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.157421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:33.157421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.157421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:33.157421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:33.157421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:33.157421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:14:33.157421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:14:33.157421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1802058213 could not be found. Jul 04 04:14:33.157421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.157421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-0619684a-afb9-4b67-89c6-0c98da6fafd1 tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] Returning 404 to user: Volume tempest-invalid-1802058213 could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:14:33.157421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-0619684a-afb9-4b67-89c6-0c98da6fafd1 tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1802058213" status: 404 len: 99 microversion: 2.1 time: 0.191093 Jul 04 04:14:33.157421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 5/6] 10.222.0.16 () {58 vars in 1217 bytes} [Mon Jul 4 04:14:32 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1802058213 => generated 99 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 04 04:14:33.159390 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c9b85268-f586-43c1-90f8-15c2af16bb6d tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.439987 Jul 04 04:14:33.161236 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2/7] 10.222.0.16 () {60 vars in 1154 bytes} [Mon Jul 4 04:14:30 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2443 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 04 04:14:33.163772 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b39fc552-72c0-4620-8c11-1eb03f4d57c3 tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004153 Jul 04 04:14:33.173692 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dfd27902-6d53-48b7-9da8-69a6f47e306f tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c2f08a60>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:33.179297 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 6/8] 10.222.0.16 () {58 vars in 1139 bytes} [Mon Jul 4 04:14:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 04 04:14:33.184205 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-2aa35d5c-85e7-4700-950e-49e42057bf9d tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003779 Jul 04 04:14:33.184716 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 7/9] 10.222.0.16 () {58 vars in 1136 bytes} [Mon Jul 4 04:14:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 04 04:14:33.218042 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3e09a03e-59c5-466f-92b9-bb4f4edafa5f tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] Calling method '.version_select at 0x7f50c2eec5e0>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:33.294194 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dfd27902-6d53-48b7-9da8-69a6f47e306f tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fad02c5c-3171-4046-8d88-36b802f9d0d3" status: 200 len: 345 microversion: 2.1 time: 0.122653 Jul 04 04:14:33.295791 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 3/10] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jul 4 04:14:33 2022] GET /compute/v2.1/os-volumes/fad02c5c-3171-4046-8d88-36b802f9d0d3 => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:14:33.344828 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-3e09a03e-59c5-466f-92b9-bb4f4edafa5f tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] HTTP exception thrown: Volume 738fc0c4-ae5b-4a43-94af-1f090eb386bb could not be found. Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3e09a03e-59c5-466f-92b9-bb4f4edafa5f tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] Request method failure captured: Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: DELETE /compute/v2.1/os-volumes/738fc0c4-ae5b-4a43-94af-1f090eb386bb HTTP/1.1 Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmkk0CeqfO6lqdBqVRPslvreKGlvXH4MW2ZMDmSSAWJPnm_y_2TUApVvZet9OLbPA6Za4zD6Zy7gp9ufNL1iW2TYKECJY5qB0Ti8zjP81TRobSAWwgDDTt1HPJ55FYkcwEuh5SvAXVkphzzNufNGGWC3aAu08t9izY9pZnLtGm1XWso Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: 94810165aeb641848b753c96ca3ad7a8 Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-VolumesNegativeTest-1910246737 Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:14:33.347509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:14:33.348894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94810165aeb641848b753c96ca3ad7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/94810165aeb641848b753c96ca3ad7a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94810165aeb641848b753c96ca3ad7a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_94810165aeb641848b753c96ca3ad7a8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:14:33.348894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-VolumesNegativeTest-1910246737 Jul 04 04:14:33.348894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: 94810165aeb641848b753c96ca3ad7a8 Jul 04 04:14:33.348894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-VolumesNegativeTest-1910246737 Jul 04 04:14:33.348894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-VolumesNegativeTest-1910246737-project Jul 04 04:14:33.348894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:14:33.348894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:14:33.348894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 1758d6fed42543fc9ff569b7051cb3e8 Jul 04 04:14:33.348894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-VolumesNegativeTest-1910246737-project Jul 04 04:14:33.348894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: Jul 04 04:14:33.348894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Volume 738fc0c4-ae5b-4a43-94af-1f090eb386bb could not be found. Jul 04 04:14:33.348894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': '738fc0c4-ae5b-4a43-94af-1f090eb386bb'} Jul 04 04:14:33.348894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:14:33.350058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:33.350058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 04:14:33.350058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 04:14:33.350058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 04:14:33.350058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 04:14:33.350058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 04:14:33.350058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 04:14:33.350058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 04:14:33.350058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 04:14:33.350058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 04:14:33.350058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 04:14:33.350058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 04:14:33.350058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 04:14:33.350058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 04:14:33.350058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 04:14:33.350058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 738fc0c4-ae5b-4a43-94af-1f090eb386bb could not be found. (HTTP 404) (Request-ID: req-e49d7607-663e-42aa-ae06-d68967a60199) Jul 04 04:14:33.350058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.350058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:33.350058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.351151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:33.351151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 04 04:14:33.351151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 04 04:14:33.351151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 04:14:33.351151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 04:14:33.351151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 04:14:33.351151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 04:14:33.351151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 04:14:33.351151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 04:14:33.351151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 04:14:33.351151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 04:14:33.351151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 04:14:33.351151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 04:14:33.351151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 04:14:33.351151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 04:14:33.351151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 04:14:33.351151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 04:14:33.351151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 04:14:33.351151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 04:14:33.352203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 04:14:33.352203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 04:14:33.352203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 04:14:33.352203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 04:14:33.352203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 738fc0c4-ae5b-4a43-94af-1f090eb386bb could not be found. Jul 04 04:14:33.352203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.352203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:33.352203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.352203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:33.352203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:33.352203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:33.352203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:14:33.352203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:14:33.352203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 04:14:33.352203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 04:14:33.352203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:14:33.352203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:14:33.352203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 04 04:14:33.352203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:14:33.353496 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 738fc0c4-ae5b-4a43-94af-1f090eb386bb could not be found. Jul 04 04:14:33.353496 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.353496 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:33.353496 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.353496 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:33.353496 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:33.353496 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:33.353496 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:14:33.353496 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:14:33.353496 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 738fc0c4-ae5b-4a43-94af-1f090eb386bb could not be found. Jul 04 04:14:33.353496 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.356553 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3e09a03e-59c5-466f-92b9-bb4f4edafa5f tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] Returning 404 to user: Volume 738fc0c4-ae5b-4a43-94af-1f090eb386bb could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:14:33.357234 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3e09a03e-59c5-466f-92b9-bb4f4edafa5f tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/738fc0c4-ae5b-4a43-94af-1f090eb386bb" status: 404 len: 109 microversion: 2.1 time: 0.142666 Jul 04 04:14:33.357987 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 8/11] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jul 4 04:14:33 2022] DELETE /compute/v2.1/os-volumes/738fc0c4-ae5b-4a43-94af-1f090eb386bb => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:14:33.372239 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4b414f47-3f2b-4611-9184-7a1f0d77a36a tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] Calling method '.version_select at 0x7f50c2f17160>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:33.419482 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-4b414f47-3f2b-4611-9184-7a1f0d77a36a tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] HTTP exception thrown: Volume 3316432b-c545-492d-bc4f-6b95215cd741 could not be found. Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4b414f47-3f2b-4611-9184-7a1f0d77a36a tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] Request method failure captured: Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/os-volumes/3316432b-c545-492d-bc4f-6b95215cd741 HTTP/1.1 Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmkk0CeqfO6lqdBqVRPslvreKGlvXH4MW2ZMDmSSAWJPnm_y_2TUApVvZet9OLbPA6Za4zD6Zy7gp9ufNL1iW2TYKECJY5qB0Ti8zjP81TRobSAWwgDDTt1HPJ55FYkcwEuh5SvAXVkphzzNufNGGWC3aAu08t9izY9pZnLtGm1XWso Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 94810165aeb641848b753c96ca3ad7a8 Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-VolumesNegativeTest-1910246737 Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:14:33.424099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:14:33.425408 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94810165aeb641848b753c96ca3ad7a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/94810165aeb641848b753c96ca3ad7a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94810165aeb641848b753c96ca3ad7a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_94810165aeb641848b753c96ca3ad7a8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:14:33.425408 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-VolumesNegativeTest-1910246737 Jul 04 04:14:33.425408 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 94810165aeb641848b753c96ca3ad7a8 Jul 04 04:14:33.425408 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-VolumesNegativeTest-1910246737 Jul 04 04:14:33.425408 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-VolumesNegativeTest-1910246737-project Jul 04 04:14:33.425408 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:14:33.425408 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:14:33.425408 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: 1758d6fed42543fc9ff569b7051cb3e8 Jul 04 04:14:33.425408 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-VolumesNegativeTest-1910246737-project Jul 04 04:14:33.425408 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: Jul 04 04:14:33.425408 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Volume 3316432b-c545-492d-bc4f-6b95215cd741 could not be found. Jul 04 04:14:33.425408 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': '3316432b-c545-492d-bc4f-6b95215cd741'} Jul 04 04:14:33.425408 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:14:33.426624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:33.426624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 04:14:33.426624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 04:14:33.426624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 04:14:33.426624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 04:14:33.426624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 04:14:33.426624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 04:14:33.426624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 04:14:33.426624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 04:14:33.426624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 04:14:33.426624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 04:14:33.426624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 04:14:33.426624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 04:14:33.426624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 04:14:33.426624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 04:14:33.426624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3316432b-c545-492d-bc4f-6b95215cd741 could not be found. (HTTP 404) (Request-ID: req-35780d48-405c-48c8-ac45-9317b88e0111) Jul 04 04:14:33.426624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.426624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:33.426624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.427710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:33.427710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 04:14:33.427710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 04:14:33.427710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 04:14:33.427710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 04:14:33.427710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 04:14:33.427710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 04:14:33.427710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 04:14:33.427710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 04:14:33.427710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 04:14:33.427710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 04:14:33.427710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 04:14:33.427710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 04:14:33.427710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 04:14:33.427710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 04:14:33.427710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 04:14:33.427710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 04:14:33.427710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 04:14:33.427710 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 04:14:33.428849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 04:14:33.428849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 04:14:33.428849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 04:14:33.428849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 04:14:33.428849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3316432b-c545-492d-bc4f-6b95215cd741 could not be found. Jul 04 04:14:33.428849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.428849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:33.428849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.428849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:33.428849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:33.428849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:33.428849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:14:33.428849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:14:33.428849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 04:14:33.428849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 04:14:33.428849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:14:33.428849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:14:33.428849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 04:14:33.428849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:14:33.429983 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3316432b-c545-492d-bc4f-6b95215cd741 could not be found. Jul 04 04:14:33.429983 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.429983 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:33.429983 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.429983 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:33.429983 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:33.429983 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:33.429983 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:14:33.429983 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:14:33.429983 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3316432b-c545-492d-bc4f-6b95215cd741 could not be found. Jul 04 04:14:33.429983 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:33.429983 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4b414f47-3f2b-4611-9184-7a1f0d77a36a tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] Returning 404 to user: Volume 3316432b-c545-492d-bc4f-6b95215cd741 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:14:33.429983 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4b414f47-3f2b-4611-9184-7a1f0d77a36a tempest-VolumesNegativeTest-1910246737 tempest-VolumesNegativeTest-1910246737-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3316432b-c545-492d-bc4f-6b95215cd741" status: 404 len: 109 microversion: 2.1 time: 0.057790 Jul 04 04:14:33.429983 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 4/12] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jul 4 04:14:33 2022] GET /compute/v2.1/os-volumes/3316432b-c545-492d-bc4f-6b95215cd741 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:14:33.946070 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a0a5c0ff-03b3-4c98-8575-3487e08d6316 tempest-VolumesGetTestJSON-500488664 tempest-VolumesGetTestJSON-500488664-project] Calling method '.version_select at 0x7f50c308a700>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:34.081746 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a0a5c0ff-03b3-4c98-8575-3487e08d6316 tempest-VolumesGetTestJSON-500488664 tempest-VolumesGetTestJSON-500488664-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/92aa56d3-a928-48b1-a2b7-ec8c25e79def" status: 200 len: 354 microversion: 2.1 time: 0.139631 Jul 04 04:14:34.082617 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 9/13] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jul 4 04:14:33 2022] GET /compute/v2.1/os-volumes/92aa56d3-a928-48b1-a2b7-ec8c25e79def => generated 354 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:14:34.094139 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a15b2c76-b4f6-43a7-b27f-832f576222ae tempest-VolumesGetTestJSON-500488664 tempest-VolumesGetTestJSON-500488664-project] Calling method '.version_select at 0x7f50c2ee8160>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:34.309203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c09fd6bc-4486-4b2d-82d8-374b83550883 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c2eec430>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:34.528393 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c09fd6bc-4486-4b2d-82d8-374b83550883 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fad02c5c-3171-4046-8d88-36b802f9d0d3" status: 200 len: 345 microversion: 2.1 time: 0.224169 Jul 04 04:14:34.529437 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 10/14] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jul 4 04:14:34 2022] GET /compute/v2.1/os-volumes/fad02c5c-3171-4046-8d88-36b802f9d0d3 => generated 345 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:14:34.599348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a15b2c76-b4f6-43a7-b27f-832f576222ae tempest-VolumesGetTestJSON-500488664 tempest-VolumesGetTestJSON-500488664-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/92aa56d3-a928-48b1-a2b7-ec8c25e79def" status: 200 len: 354 microversion: 2.1 time: 0.508953 Jul 04 04:14:34.600566 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 5/15] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jul 4 04:14:34 2022] GET /compute/v2.1/os-volumes/92aa56d3-a928-48b1-a2b7-ec8c25e79def => generated 354 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:14:34.620218 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ec6ecb9c-b251-4a77-bb31-ef69bc910537 tempest-VolumesGetTestJSON-500488664 tempest-VolumesGetTestJSON-500488664-project] Calling method '.version_select at 0x7f50c2eecf70>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:35.074650 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ec6ecb9c-b251-4a77-bb31-ef69bc910537 tempest-VolumesGetTestJSON-500488664 tempest-VolumesGetTestJSON-500488664-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/92aa56d3-a928-48b1-a2b7-ec8c25e79def" status: 202 len: 0 microversion: 2.1 time: 0.458122 Jul 04 04:14:35.075512 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 11/16] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jul 4 04:14:34 2022] DELETE /compute/v2.1/os-volumes/92aa56d3-a928-48b1-a2b7-ec8c25e79def => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:14:35.084484 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2ab2e29e-4dc8-4ff6-9209-dad5c2c8c4ae tempest-VolumesGetTestJSON-500488664 tempest-VolumesGetTestJSON-500488664-project] Calling method '.version_select at 0x7f50c2ee88b0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:35.168950 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2ab2e29e-4dc8-4ff6-9209-dad5c2c8c4ae tempest-VolumesGetTestJSON-500488664 tempest-VolumesGetTestJSON-500488664-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/92aa56d3-a928-48b1-a2b7-ec8c25e79def" status: 200 len: 353 microversion: 2.1 time: 0.089122 Jul 04 04:14:35.169612 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 6/17] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jul 4 04:14:35 2022] GET /compute/v2.1/os-volumes/92aa56d3-a928-48b1-a2b7-ec8c25e79def => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:14:35.542610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-0eaaa1f4-4356-4014-9b1a-45999f49255f tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c2eec310>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:35.630312 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-0eaaa1f4-4356-4014-9b1a-45999f49255f tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fad02c5c-3171-4046-8d88-36b802f9d0d3" status: 200 len: 346 microversion: 2.1 time: 0.091706 Jul 04 04:14:35.633801 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 12/18] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jul 4 04:14:35 2022] GET /compute/v2.1/os-volumes/fad02c5c-3171-4046-8d88-36b802f9d0d3 => generated 346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:14:35.646200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4a6d37e4-fca6-40ca-85ca-6b06a8b79c18 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Action: 'create', calling method: .version_select at 0x7f50c2ee8f70>, body: {"snapshot": {"volume_id": "fad02c5c-3171-4046-8d88-36b802f9d0d3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2059233369"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:14:36.023527 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4a6d37e4-fca6-40ca-85ca-6b06a8b79c18 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.381713 Jul 04 04:14:36.029266 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 7/19] 10.222.0.16 () {60 vars in 1161 bytes} [Mon Jul 4 04:14:35 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:14:36.035741 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-67378486-955a-443e-a0b8-af9067d4768c tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c37ac040>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:36.182313 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-37dc68a6-b668-4519-b8d0-37130903f5d3 tempest-VolumesGetTestJSON-500488664 tempest-VolumesGetTestJSON-500488664-project] Calling method '.version_select at 0x7f50c2ee8670>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:36.212067 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-67378486-955a-443e-a0b8-af9067d4768c tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a" status: 200 len: 287 microversion: 2.1 time: 0.181256 Jul 04 04:14:36.213159 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 13/20] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jul 4 04:14:36 2022] GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a => generated 287 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:14:36.242563 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-906ccaf2-0cf2-4ea4-923c-ace3d1b1a058 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c2f04ca0>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:36.271933 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-37dc68a6-b668-4519-b8d0-37130903f5d3 tempest-VolumesGetTestJSON-500488664 tempest-VolumesGetTestJSON-500488664-project] HTTP exception thrown: Volume 92aa56d3-a928-48b1-a2b7-ec8c25e79def could not be found. Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-37dc68a6-b668-4519-b8d0-37130903f5d3 tempest-VolumesGetTestJSON-500488664 tempest-VolumesGetTestJSON-500488664-project] Request method failure captured: Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/os-volumes/92aa56d3-a928-48b1-a2b7-ec8c25e79def HTTP/1.1 Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmkkFHdwWBGmuK-eS9Q5XoNATmrbmCM6__BD47KAtEpMIP_JNlgQ-0vd_Jo4omSyxeCJlRj7QIQ_UR30QGlhulVB5Szf3cYjZ5AQkXMRVz3liSkFr1yfqyFhxTxs6utM8y9Rrp7zJLP4w9ff6Qgc7VQNwYoSoWc98EAkyRTNKVvEPGo Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 16c2e6487a1b435c9a362c1fd52b9978 Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-VolumesGetTestJSON-500488664 Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:14:36.274655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:14:36.275896 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/16c2e6487a1b435c9a362c1fd52b9978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/16c2e6487a1b435c9a362c1fd52b9978"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/16c2e6487a1b435c9a362c1fd52b9978"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_16c2e6487a1b435c9a362c1fd52b9978", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:14:36.275896 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-VolumesGetTestJSON-500488664 Jul 04 04:14:36.275896 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 16c2e6487a1b435c9a362c1fd52b9978 Jul 04 04:14:36.275896 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-VolumesGetTestJSON-500488664 Jul 04 04:14:36.275896 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-VolumesGetTestJSON-500488664-project Jul 04 04:14:36.275896 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:14:36.275896 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:14:36.275896 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: c756a1bc870a4ec5a5b629c91e6e84a3 Jul 04 04:14:36.275896 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-VolumesGetTestJSON-500488664-project Jul 04 04:14:36.275896 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: Jul 04 04:14:36.275896 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Volume 92aa56d3-a928-48b1-a2b7-ec8c25e79def could not be found. Jul 04 04:14:36.275896 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': '92aa56d3-a928-48b1-a2b7-ec8c25e79def'} Jul 04 04:14:36.275896 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:14:36.276556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:36.276556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 04:14:36.276556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 04:14:36.276556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 04:14:36.276556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 04:14:36.276556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 04:14:36.276556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 04:14:36.276556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 04:14:36.276556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 04:14:36.276556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 04:14:36.276556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 04:14:36.276556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 04:14:36.276556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 04:14:36.276556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 04:14:36.276556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 04:14:36.276556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 92aa56d3-a928-48b1-a2b7-ec8c25e79def could not be found. (HTTP 404) (Request-ID: req-137437d9-e9e0-4809-b477-13d2bed247c1) Jul 04 04:14:36.276556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:36.276556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:36.276556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:36.277486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:36.277486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 04:14:36.277486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 04:14:36.277486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 04:14:36.277486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 04:14:36.277486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 04:14:36.277486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 04:14:36.277486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 04:14:36.277486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 04:14:36.277486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 04:14:36.277486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 04:14:36.277486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 04:14:36.277486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 04:14:36.277486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 04:14:36.277486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 04:14:36.277486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 04:14:36.277486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 04:14:36.277486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 04:14:36.277486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 04:14:36.278340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 04:14:36.278340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 04:14:36.278340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 04:14:36.278340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 04:14:36.278340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 92aa56d3-a928-48b1-a2b7-ec8c25e79def could not be found. Jul 04 04:14:36.278340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:36.278340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:36.278340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:36.278340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:36.278340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:36.278340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:36.278340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:14:36.278340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:14:36.278340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 04:14:36.278340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 04:14:36.278340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:14:36.278340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:14:36.278340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 04:14:36.278340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:14:36.279559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 92aa56d3-a928-48b1-a2b7-ec8c25e79def could not be found. Jul 04 04:14:36.279559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:36.279559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:36.279559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:36.279559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:36.279559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:36.279559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:36.279559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:14:36.279559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:14:36.279559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 92aa56d3-a928-48b1-a2b7-ec8c25e79def could not be found. Jul 04 04:14:36.279559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:36.281674 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-37dc68a6-b668-4519-b8d0-37130903f5d3 tempest-VolumesGetTestJSON-500488664 tempest-VolumesGetTestJSON-500488664-project] Returning 404 to user: Volume 92aa56d3-a928-48b1-a2b7-ec8c25e79def could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:14:36.282935 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-37dc68a6-b668-4519-b8d0-37130903f5d3 tempest-VolumesGetTestJSON-500488664 tempest-VolumesGetTestJSON-500488664-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/92aa56d3-a928-48b1-a2b7-ec8c25e79def" status: 404 len: 109 microversion: 2.1 time: 0.105339 Jul 04 04:14:36.284466 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 8/21] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jul 4 04:14:36 2022] GET /compute/v2.1/os-volumes/92aa56d3-a928-48b1-a2b7-ec8c25e79def => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 04:14:36.351988 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-906ccaf2-0cf2-4ea4-923c-ace3d1b1a058 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.130402 Jul 04 04:14:36.352884 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 14/22] 10.222.0.16 () {58 vars in 1139 bytes} [Mon Jul 4 04:14:36 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:14:36.366244 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-82f5bfc6-38c5-469b-a685-7f110410de81 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c2f17f70>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:36.461467 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-82f5bfc6-38c5-469b-a685-7f110410de81 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a" status: 200 len: 287 microversion: 2.1 time: 0.099069 Jul 04 04:14:36.466555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 9/23] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jul 4 04:14:36 2022] GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a => generated 287 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:14:37.474258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-875d92e7-0ffd-42d2-b8bc-09837fde3922 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c37ac040>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:37.562511 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-875d92e7-0ffd-42d2-b8bc-09837fde3922 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a" status: 200 len: 287 microversion: 2.1 time: 0.092780 Jul 04 04:14:37.566945 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 15/24] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jul 4 04:14:37 2022] GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:14:38.170886 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2e5bc9bd-a791-4d98-9a52-80d4ecae9265 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-769092925", "imageRef": "46b9937d-f997-401a-a3aa-bb9028764454", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:14:38.398962 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-2e5bc9bd-a791-4d98-9a52-80d4ecae9265 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] validate_networks() for [('6b852890-6d40-459d-8b3f-cc97ada90f12', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:14:38.583431 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b0565aaf-4e8a-4ccd-a36c-faac028161ff tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c2eec700>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:38.677689 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b0565aaf-4e8a-4ccd-a36c-faac028161ff tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a" status: 200 len: 287 microversion: 2.1 time: 0.105330 Jul 04 04:14:38.682058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 16/25] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jul 4 04:14:38 2022] GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a => generated 287 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:14:39.689624 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-fb2e072d-d2f5-4dae-8340-0f47c5d23a2c tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c2eec0d0>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:39.796658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-fb2e072d-d2f5-4dae-8340-0f47c5d23a2c tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a" status: 200 len: 287 microversion: 2.1 time: 0.111151 Jul 04 04:14:39.801045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 17/26] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jul 4 04:14:39 2022] GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a => generated 287 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:14:40.365811 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-cf10dcd6-ff17-4275-b1d6-be8053dcbe72 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Action: 'create', calling method: .version_select at 0x7f50c2e79550>, body: {"keypair": {"name": "tempest-keypair-1985432091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs3rScbs15QOGa9s88VP6/67BWxL7Vpb8OOlTujrgXv4lzr+ek+aNU33lsLknZt3/EquhqBuWdcWNYlVQxV5fHbcWTVJuiVWKbXJJC9DnGw/xP/wpD/TL5fbBe60HeCpg=="}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:14:40.497233 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-cf10dcd6-ff17-4275-b1d6-be8053dcbe72 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Getting quotas for project 7ccd298eebe6413daaae0d801e902616. Resources: {'key_pairs'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:14:40.518261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-cf10dcd6-ff17-4275-b1d6-be8053dcbe72 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Getting quotas for user 4041faa2919d4760ae10907070a10dc7 and project 7ccd298eebe6413daaae0d801e902616. Resources: {'key_pairs'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:14:40.650886 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-cf10dcd6-ff17-4275-b1d6-be8053dcbe72 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.852356 Jul 04 04:14:40.652317 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 18/27] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jul 4 04:14:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:14:40.811561 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3d20dac7-f07b-42a7-a83d-f3c6c9f51024 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c2e4ec10>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:40.903649 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3d20dac7-f07b-42a7-a83d-f3c6c9f51024 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a" status: 200 len: 287 microversion: 2.1 time: 0.098730 Jul 04 04:14:40.904625 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 19/28] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jul 4 04:14:40 2022] GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:14:41.916014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-389ad57b-94e6-4fd6-8855-1c3e97973fa0 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c2606280>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:41.991214 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-389ad57b-94e6-4fd6-8855-1c3e97973fa0 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a" status: 200 len: 287 microversion: 2.1 time: 0.078966 Jul 04 04:14:41.992285 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 20/29] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jul 4 04:14:41 2022] GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:14:42.760938 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-2e5bc9bd-a791-4d98-9a52-80d4ecae9265 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:14:42.761423 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-2e5bc9bd-a791-4d98-9a52-80d4ecae9265 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:14:42.761777 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-2e5bc9bd-a791-4d98-9a52-80d4ecae9265 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:14:42.762182 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-2e5bc9bd-a791-4d98-9a52-80d4ecae9265 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:14:42.762626 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-2e5bc9bd-a791-4d98-9a52-80d4ecae9265 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:14:42.794933 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e5bc9bd-a791-4d98-9a52-80d4ecae9265 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:42.795390 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e5bc9bd-a791-4d98-9a52-80d4ecae9265 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:42.796267 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e5bc9bd-a791-4d98-9a52-80d4ecae9265 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:42.796704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e5bc9bd-a791-4d98-9a52-80d4ecae9265 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:42.917243 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-2e5bc9bd-a791-4d98-9a52-80d4ecae9265 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Getting quotas for project 7ea328a1154a4a9a955e411f7eab0aa9. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:14:42.933440 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-2e5bc9bd-a791-4d98-9a52-80d4ecae9265 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Getting quotas for user dca54bc220104e79aa727f30399f3411 and project 7ea328a1154a4a9a955e411f7eab0aa9. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:14:42.970653 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2e5bc9bd-a791-4d98-9a52-80d4ecae9265 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:14:42.982713 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2e5bc9bd-a791-4d98-9a52-80d4ecae9265 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46b9937d-f997-401a-a3aa-bb9028764454',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:14:43.012944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-60800af8-c9bc-4093-b577-3ac9d03a9b8e tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c2e4ee50>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:43.089995 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-60800af8-c9bc-4093-b577-3ac9d03a9b8e tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a" status: 200 len: 288 microversion: 2.1 time: 0.081720 Jul 04 04:14:43.090846 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 21/30] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jul 4 04:14:43 2022] GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a => generated 288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:14:43.103050 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e38f5944-209e-4274-b5b6-9e8bae1b1c6a tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c2e4e670>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:43.284333 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e38f5944-209e-4274-b5b6-9e8bae1b1c6a tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a" status: 202 len: 0 microversion: 2.1 time: 0.186138 Jul 04 04:14:43.284911 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 22/31] 10.222.0.16 () {58 vars in 1253 bytes} [Mon Jul 4 04:14:43 2022] DELETE /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 04:14:43.291487 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2e5bc9bd-a791-4d98-9a52-80d4ecae9265 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.429510 Jul 04 04:14:43.293183 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-01e7b637-958d-4110-804a-4d6c263514cf tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c2606160>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:43.296750 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 10/32] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:14:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 5435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 04:14:43.313873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-80cb8482-1e9e-4ece-b4c5-84bae1207aa0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:43.315031 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-80cb8482-1e9e-4ece-b4c5-84bae1207aa0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:43.375771 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-01e7b637-958d-4110-804a-4d6c263514cf tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a" status: 200 len: 287 microversion: 2.1 time: 0.086354 Jul 04 04:14:43.380104 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 23/33] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jul 4 04:14:43 2022] GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:14:43.689672 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-80cb8482-1e9e-4ece-b4c5-84bae1207aa0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:43.744864 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-80cb8482-1e9e-4ece-b4c5-84bae1207aa0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1221 microversion: 2.1 time: 0.435782 Jul 04 04:14:43.749625 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 11/34] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:43 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1221 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:44.143099 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e4486b68-7e40-43fa-9699-3d749227fdd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1276953807", "imageRef": "46b9937d-f997-401a-a3aa-bb9028764454", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:14:44.275025 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.network.neutron [None req-e4486b68-7e40-43fa-9699-3d749227fdd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] validate_networks() for [('6b852890-6d40-459d-8b3f-cc97ada90f12', None, None, None, None, None)] {{(pid=117875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:14:44.387969 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-914920c0-8801-4d3a-9b71-90cedc4dbf24 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c2de13a0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:44.464595 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-914920c0-8801-4d3a-9b71-90cedc4dbf24 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] HTTP exception thrown: Snapshot 79c97e80-0faa-4e17-a2c3-3970a2c2692a could not be found. Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-914920c0-8801-4d3a-9b71-90cedc4dbf24 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Request method failure captured: Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a HTTP/1.1 Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmklcT503HsPhnHss9WiInvtRL9GFHcjAg5QvqedUe9M-IFtx61g-ULotGYKK3S5nOqmBykHcKcHpTBGu1lPAAu16ZKhp14aBHDFyA98mXvf0OSLj1SKGVjQLsWcsETKWi_I1pkQXt6ZUacUSj43954QAbTY7iCcRUrC2U4sUtAlylQ Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: a16deb2e741f484e94c851cddd0cc952 Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-477296401 Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:14:44.467861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:14:44.469018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a16deb2e741f484e94c851cddd0cc952"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a16deb2e741f484e94c851cddd0cc952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a16deb2e741f484e94c851cddd0cc952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a16deb2e741f484e94c851cddd0cc952", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:14:44.469018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-VolumesSnapshotsTestJSON-477296401 Jul 04 04:14:44.469018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: a16deb2e741f484e94c851cddd0cc952 Jul 04 04:14:44.469018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-477296401 Jul 04 04:14:44.469018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-VolumesSnapshotsTestJSON-477296401-project Jul 04 04:14:44.469018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:14:44.469018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:14:44.469018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: 0fe5a01615e5474486c05dc809dd125d Jul 04 04:14:44.469018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-VolumesSnapshotsTestJSON-477296401-project Jul 04 04:14:44.469018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: Jul 04 04:14:44.469018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Snapshot 79c97e80-0faa-4e17-a2c3-3970a2c2692a could not be found. Jul 04 04:14:44.469018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': '79c97e80-0faa-4e17-a2c3-3970a2c2692a'} Jul 04 04:14:44.469018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:14:44.469733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:44.469733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 04 04:14:44.469733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 04 04:14:44.469733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 04 04:14:44.469733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 04 04:14:44.469733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 04 04:14:44.469733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 04 04:14:44.469733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 04:14:44.469733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 04:14:44.469733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 04:14:44.469733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 04:14:44.469733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 04:14:44.469733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 04:14:44.469733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 04:14:44.469733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 04:14:44.469733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 79c97e80-0faa-4e17-a2c3-3970a2c2692a could not be found. (HTTP 404) (Request-ID: req-692e2013-79c2-4123-b584-da427134fe11) Jul 04 04:14:44.469733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:44.469733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:44.470705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:44.470705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:44.470705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 04 04:14:44.470705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 04 04:14:44.470705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 04:14:44.470705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 04:14:44.470705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 04 04:14:44.470705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 04 04:14:44.470705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 04:14:44.470705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 04:14:44.470705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 04 04:14:44.470705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 04 04:14:44.470705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 04 04:14:44.470705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 04 04:14:44.470705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 04 04:14:44.470705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 04 04:14:44.470705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 04:14:44.470705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 04:14:44.470705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 79c97e80-0faa-4e17-a2c3-3970a2c2692a could not be found. Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 04 04:14:44.471656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:14:44.472788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 79c97e80-0faa-4e17-a2c3-3970a2c2692a could not be found. Jul 04 04:14:44.472788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:44.472788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:44.472788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:44.472788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:44.472788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:44.472788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:44.472788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:14:44.472788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:14:44.472788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 79c97e80-0faa-4e17-a2c3-3970a2c2692a could not be found. Jul 04 04:14:44.472788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:44.473865 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-914920c0-8801-4d3a-9b71-90cedc4dbf24 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Returning 404 to user: Snapshot 79c97e80-0faa-4e17-a2c3-3970a2c2692a could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:14:44.474987 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-914920c0-8801-4d3a-9b71-90cedc4dbf24 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a" status: 404 len: 111 microversion: 2.1 time: 0.091037 Jul 04 04:14:44.476021 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 12/35] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jul 4 04:14:44 2022] GET /compute/v2.1/os-snapshots/79c97e80-0faa-4e17-a2c3-3970a2c2692a => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 04:14:44.493159 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-88b47b1c-09a0-4d2c-8cb4-17f74d39bc60 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c2df6940>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:44.711822 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-88b47b1c-09a0-4d2c-8cb4-17f74d39bc60 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/fad02c5c-3171-4046-8d88-36b802f9d0d3" status: 202 len: 0 microversion: 2.1 time: 0.230794 Jul 04 04:14:44.713547 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 13/36] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jul 4 04:14:44 2022] DELETE /compute/v2.1/os-volumes/fad02c5c-3171-4046-8d88-36b802f9d0d3 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:14:44.722139 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5d35b0fd-2bfc-483d-935f-6e8307c18ad0 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c1d8b700>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:44.842666 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5d35b0fd-2bfc-483d-935f-6e8307c18ad0 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fad02c5c-3171-4046-8d88-36b802f9d0d3" status: 200 len: 345 microversion: 2.1 time: 0.124703 Jul 04 04:14:44.843560 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 14/37] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jul 4 04:14:44 2022] GET /compute/v2.1/os-volumes/fad02c5c-3171-4046-8d88-36b802f9d0d3 => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:14:44.931093 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-09a5d3cf-29c3-403d-9c7f-6b6f6a429571 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-89364895", "imageRef": "46b9937d-f997-401a-a3aa-bb9028764454", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0e412eaf-c623-4c5a-9f62-8e6b8ef74b11"}], "security_groups": [{"name": "tempest-securitygroup--230242189"}], "key_name": "tempest-keypair-1985432091", "user_data": "}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:14:45.175914 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-09a5d3cf-29c3-403d-9c7f-6b6f6a429571 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] validate_networks() for [('0e412eaf-c623-4c5a-9f62-8e6b8ef74b11', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:14:45.960792 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-09a5d3cf-29c3-403d-9c7f-6b6f6a429571 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:14:45.961387 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-09a5d3cf-29c3-403d-9c7f-6b6f6a429571 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:14:45.961842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-09a5d3cf-29c3-403d-9c7f-6b6f6a429571 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:14:45.962275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-09a5d3cf-29c3-403d-9c7f-6b6f6a429571 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:14:45.962764 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-09a5d3cf-29c3-403d-9c7f-6b6f6a429571 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:14:45.973287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-09a5d3cf-29c3-403d-9c7f-6b6f6a429571 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:45.975341 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-09a5d3cf-29c3-403d-9c7f-6b6f6a429571 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:45.978111 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-09a5d3cf-29c3-403d-9c7f-6b6f6a429571 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:45.979746 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-09a5d3cf-29c3-403d-9c7f-6b6f6a429571 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:46.018306 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-09a5d3cf-29c3-403d-9c7f-6b6f6a429571 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Getting quotas for project 7ccd298eebe6413daaae0d801e902616. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:14:46.030953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-09a5d3cf-29c3-403d-9c7f-6b6f6a429571 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Getting quotas for user 4041faa2919d4760ae10907070a10dc7 and project 7ccd298eebe6413daaae0d801e902616. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:14:46.054691 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-09a5d3cf-29c3-403d-9c7f-6b6f6a429571 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:14:46.057342 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-09a5d3cf-29c3-403d-9c7f-6b6f6a429571 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46b9937d-f997-401a-a3aa-bb9028764454',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:14:46.151181 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-09a5d3cf-29c3-403d-9c7f-6b6f6a429571 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.225936 Jul 04 04:14:46.152611 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 15/38] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:14:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 04:14:46.158611 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c2fd1e75-94b3-4210-b2c2-988bc0f09a7c tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c1d9e940>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:46.210718 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-c2fd1e75-94b3-4210-b2c2-988bc0f09a7c tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] HTTP exception thrown: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c2fd1e75-94b3-4210-b2c2-988bc0f09a7c tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Request method failure captured: Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/os-volumes/fad02c5c-3171-4046-8d88-36b802f9d0d3 HTTP/1.1 Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmklcT503HsPhnHss9WiInvtRL9GFHcjAg5QvqedUe9M-IFtx61g-ULotGYKK3S5nOqmBykHcKcHpTBGu1lPAAu16ZKhp14aBHDFyA98mXvf0OSLj1SKGVjQLsWcsETKWi_I1pkQXt6ZUacUSj43954QAbTY7iCcRUrC2U4sUtAlylQ Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: a16deb2e741f484e94c851cddd0cc952 Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-477296401 Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:14:46.213851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:14:46.215388 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a16deb2e741f484e94c851cddd0cc952"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a16deb2e741f484e94c851cddd0cc952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a16deb2e741f484e94c851cddd0cc952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a16deb2e741f484e94c851cddd0cc952", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:14:46.215388 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-VolumesSnapshotsTestJSON-477296401 Jul 04 04:14:46.215388 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: a16deb2e741f484e94c851cddd0cc952 Jul 04 04:14:46.215388 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-477296401 Jul 04 04:14:46.215388 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-VolumesSnapshotsTestJSON-477296401-project Jul 04 04:14:46.215388 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:14:46.215388 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:14:46.215388 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: 0fe5a01615e5474486c05dc809dd125d Jul 04 04:14:46.215388 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-VolumesSnapshotsTestJSON-477296401-project Jul 04 04:14:46.215388 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: Jul 04 04:14:46.215388 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. Jul 04 04:14:46.215388 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': 'fad02c5c-3171-4046-8d88-36b802f9d0d3'} Jul 04 04:14:46.215388 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:14:46.216091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:46.216091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 04:14:46.216091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 04:14:46.216091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 04:14:46.216091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 04:14:46.216091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 04:14:46.216091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 04:14:46.216091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 04:14:46.216091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 04:14:46.216091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 04:14:46.216091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 04:14:46.216091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 04:14:46.216091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 04:14:46.216091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 04:14:46.216091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 04:14:46.216091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. (HTTP 404) (Request-ID: req-77a37f5c-e316-405a-ba97-a13c4ed3177b) Jul 04 04:14:46.216091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:46.216091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:46.216091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:46.217019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:46.217019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 04:14:46.217019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 04:14:46.217019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 04:14:46.217019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 04:14:46.217019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 04:14:46.217019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 04:14:46.217019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 04:14:46.217019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 04:14:46.217019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 04:14:46.217019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 04:14:46.217019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 04:14:46.217019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 04:14:46.217019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 04:14:46.217019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 04:14:46.217019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 04:14:46.217019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 04:14:46.217019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 04:14:46.217019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 04:14:46.217924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 04:14:46.217924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 04:14:46.217924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 04:14:46.217924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 04:14:46.217924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. Jul 04 04:14:46.217924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:46.217924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:46.217924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:46.217924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:46.217924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:46.217924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:46.217924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:14:46.217924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:14:46.217924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 04:14:46.217924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 04:14:46.217924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:14:46.217924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:14:46.217924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 04:14:46.217924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:14:46.218954 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. Jul 04 04:14:46.218954 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:46.218954 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:46.218954 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:46.218954 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:46.218954 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:46.218954 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:46.218954 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:14:46.218954 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:14:46.218954 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. Jul 04 04:14:46.218954 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:14:46.222472 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c2fd1e75-94b3-4210-b2c2-988bc0f09a7c tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Returning 404 to user: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:14:46.224107 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c2fd1e75-94b3-4210-b2c2-988bc0f09a7c tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fad02c5c-3171-4046-8d88-36b802f9d0d3" status: 404 len: 109 microversion: 2.1 time: 0.069744 Jul 04 04:14:46.225998 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 16/39] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jul 4 04:14:46 2022] GET /compute/v2.1/os-volumes/fad02c5c-3171-4046-8d88-36b802f9d0d3 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:14:47.011993 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-e4486b68-7e40-43fa-9699-3d749227fdd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Flavor limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:14:47.013183 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-e4486b68-7e40-43fa-9699-3d749227fdd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Image limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:14:47.014328 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-e4486b68-7e40-43fa-9699-3d749227fdd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Flavor pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:14:47.014971 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-e4486b68-7e40-43fa-9699-3d749227fdd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Image pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:14:47.015535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-e4486b68-7e40-43fa-9699-3d749227fdd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:14:47.042814 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4486b68-7e40-43fa-9699-3d749227fdd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:47.044666 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4486b68-7e40-43fa-9699-3d749227fdd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:47.048296 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4486b68-7e40-43fa-9699-3d749227fdd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:47.048919 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4486b68-7e40-43fa-9699-3d749227fdd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:47.073271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ff7af654-df98-4074-9222-c2a0f4c7e73c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1274466765", "imageRef": "46b9937d-f997-401a-a3aa-bb9028764454", "flavorRef": "452", "networks": [{"uuid": "aed25219-687f-45ba-80be-abe14c80c9f4"}]}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:14:47.144497 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-e4486b68-7e40-43fa-9699-3d749227fdd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Getting quotas for project 7ea328a1154a4a9a955e411f7eab0aa9. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:14:47.157604 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-e4486b68-7e40-43fa-9699-3d749227fdd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Getting quotas for user dca54bc220104e79aa727f30399f3411 and project 7ea328a1154a4a9a955e411f7eab0aa9. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:14:47.170567 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-ff7af654-df98-4074-9222-c2a0f4c7e73c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] validate_networks() for [('aed25219-687f-45ba-80be-abe14c80c9f4', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:14:47.196915 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e4486b68-7e40-43fa-9699-3d749227fdd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Going to run 1 instances... {{(pid=117875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:14:47.203898 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e4486b68-7e40-43fa-9699-3d749227fdd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46b9937d-f997-401a-a3aa-bb9028764454',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:14:47.406847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e4486b68-7e40-43fa-9699-3d749227fdd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.268973 Jul 04 04:14:47.408063 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 24/40] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:14:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 3271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 04:14:47.414141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-cb11368d-c4a2-4652-84ec-ab37c33a5414 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:47.415554 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-cb11368d-c4a2-4652-84ec-ab37c33a5414 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:47.537998 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-cb11368d-c4a2-4652-84ec-ab37c33a5414 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:47.580949 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-cb11368d-c4a2-4652-84ec-ab37c33a5414 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1240 microversion: 2.1 time: 0.171295 Jul 04 04:14:47.587523 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 25/41] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:47 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1240 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:47.605309 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-58f43e8c-ba29-456f-8154-7004497cbf5c tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c257edc0>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:47.678314 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-58f43e8c-ba29-456f-8154-7004497cbf5c tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] HTTP exception thrown: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-58f43e8c-ba29-456f-8154-7004497cbf5c tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Request method failure captured: Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: DELETE /compute/v2.1/os-volumes/fad02c5c-3171-4046-8d88-36b802f9d0d3 HTTP/1.1 Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmklcT503HsPhnHss9WiInvtRL9GFHcjAg5QvqedUe9M-IFtx61g-ULotGYKK3S5nOqmBykHcKcHpTBGu1lPAAu16ZKhp14aBHDFyA98mXvf0OSLj1SKGVjQLsWcsETKWi_I1pkQXt6ZUacUSj43954QAbTY7iCcRUrC2U4sUtAlylQ Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: a16deb2e741f484e94c851cddd0cc952 Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-477296401 Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:14:47.680917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:14:47.682177 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a16deb2e741f484e94c851cddd0cc952"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a16deb2e741f484e94c851cddd0cc952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a16deb2e741f484e94c851cddd0cc952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a16deb2e741f484e94c851cddd0cc952", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:14:47.682177 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-VolumesSnapshotsTestJSON-477296401 Jul 04 04:14:47.682177 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: a16deb2e741f484e94c851cddd0cc952 Jul 04 04:14:47.682177 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-477296401 Jul 04 04:14:47.682177 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-VolumesSnapshotsTestJSON-477296401-project Jul 04 04:14:47.682177 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:14:47.682177 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:14:47.682177 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 0fe5a01615e5474486c05dc809dd125d Jul 04 04:14:47.682177 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-VolumesSnapshotsTestJSON-477296401-project Jul 04 04:14:47.682177 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: Jul 04 04:14:47.682177 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. Jul 04 04:14:47.682177 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': 'fad02c5c-3171-4046-8d88-36b802f9d0d3'} Jul 04 04:14:47.682177 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:14:47.682925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:47.682925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 04:14:47.682925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 04:14:47.682925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 04:14:47.682925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 04:14:47.682925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 04:14:47.682925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 04:14:47.682925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 04:14:47.682925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 04:14:47.682925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 04:14:47.682925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 04:14:47.682925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 04:14:47.682925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 04:14:47.682925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 04:14:47.682925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 04:14:47.682925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. (HTTP 404) (Request-ID: req-35923c7d-2174-473d-a84d-085147093562) Jul 04 04:14:47.682925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:47.682925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:47.682925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:47.684001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:47.684001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 04 04:14:47.684001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 04 04:14:47.684001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 04:14:47.684001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 04:14:47.684001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 04:14:47.684001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 04:14:47.684001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 04:14:47.684001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 04:14:47.684001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 04:14:47.684001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 04:14:47.684001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 04:14:47.684001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 04:14:47.684001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 04:14:47.684001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 04:14:47.684001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 04:14:47.684001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 04:14:47.684001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 04:14:47.684001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 04:14:47.686916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 04:14:47.686916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 04:14:47.686916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 04:14:47.686916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 04:14:47.686916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. Jul 04 04:14:47.686916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:47.686916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:47.686916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:47.686916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:47.686916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:47.686916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:47.686916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:14:47.686916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:14:47.686916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 04:14:47.686916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 04:14:47.686916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:14:47.686916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:14:47.686916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 04 04:14:47.686916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:14:47.688201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. Jul 04 04:14:47.688201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:47.688201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:47.688201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:47.688201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:47.688201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:47.688201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:47.688201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:14:47.688201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:14:47.688201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. Jul 04 04:14:47.688201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:47.691044 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-58f43e8c-ba29-456f-8154-7004497cbf5c tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Returning 404 to user: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:14:47.693483 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-58f43e8c-ba29-456f-8154-7004497cbf5c tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/fad02c5c-3171-4046-8d88-36b802f9d0d3" status: 404 len: 109 microversion: 2.1 time: 0.104646 Jul 04 04:14:47.694420 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 26/42] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jul 4 04:14:47 2022] DELETE /compute/v2.1/os-volumes/fad02c5c-3171-4046-8d88-36b802f9d0d3 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:14:47.717959 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-993ad78f-a117-489d-ac22-df6e8bf3d33d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:47.719022 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-993ad78f-a117-489d-ac22-df6e8bf3d33d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:47.833298 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-993ad78f-a117-489d-ac22-df6e8bf3d33d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:47.843636 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-993ad78f-a117-489d-ac22-df6e8bf3d33d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1222 microversion: 2.1 time: 0.147366 Jul 04 04:14:47.845839 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 27/43] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:47 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1222 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:47.858602 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a9315aa9-8497-443f-9550-93b21b989332 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Calling method '.version_select at 0x7f50c154dca0>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:47.918354 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-a9315aa9-8497-443f-9550-93b21b989332 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] HTTP exception thrown: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a9315aa9-8497-443f-9550-93b21b989332 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Request method failure captured: Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/os-volumes/fad02c5c-3171-4046-8d88-36b802f9d0d3 HTTP/1.1 Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmklcT503HsPhnHss9WiInvtRL9GFHcjAg5QvqedUe9M-IFtx61g-ULotGYKK3S5nOqmBykHcKcHpTBGu1lPAAu16ZKhp14aBHDFyA98mXvf0OSLj1SKGVjQLsWcsETKWi_I1pkQXt6ZUacUSj43954QAbTY7iCcRUrC2U4sUtAlylQ Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: a16deb2e741f484e94c851cddd0cc952 Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-477296401 Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:14:47.921876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:14:47.923201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a16deb2e741f484e94c851cddd0cc952"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a16deb2e741f484e94c851cddd0cc952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a16deb2e741f484e94c851cddd0cc952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a16deb2e741f484e94c851cddd0cc952", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:14:47.923201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-VolumesSnapshotsTestJSON-477296401 Jul 04 04:14:47.923201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: a16deb2e741f484e94c851cddd0cc952 Jul 04 04:14:47.923201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-477296401 Jul 04 04:14:47.923201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-VolumesSnapshotsTestJSON-477296401-project Jul 04 04:14:47.923201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:14:47.923201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:14:47.923201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 0fe5a01615e5474486c05dc809dd125d Jul 04 04:14:47.923201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-VolumesSnapshotsTestJSON-477296401-project Jul 04 04:14:47.923201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: Jul 04 04:14:47.923201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. Jul 04 04:14:47.923201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': 'fad02c5c-3171-4046-8d88-36b802f9d0d3'} Jul 04 04:14:47.923201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:14:47.923989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:47.923989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 04:14:47.923989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 04:14:47.923989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 04:14:47.923989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 04:14:47.923989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 04:14:47.923989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 04:14:47.923989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 04:14:47.923989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 04:14:47.923989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 04:14:47.923989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 04:14:47.923989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 04:14:47.923989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 04:14:47.923989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 04:14:47.923989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 04:14:47.923989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. (HTTP 404) (Request-ID: req-7164738f-cb00-44ec-b5f3-6eba46c80955) Jul 04 04:14:47.923989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:47.923989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:47.923989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:47.925442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:47.925442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 04:14:47.925442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 04:14:47.925442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 04:14:47.925442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 04:14:47.925442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 04:14:47.925442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 04:14:47.925442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 04:14:47.925442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 04:14:47.925442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 04:14:47.925442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 04:14:47.925442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 04:14:47.925442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 04:14:47.925442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 04:14:47.925442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 04:14:47.925442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 04:14:47.925442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 04:14:47.925442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 04:14:47.925442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 04:14:47.926836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 04:14:47.926836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 04:14:47.926836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 04:14:47.926836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 04:14:47.926836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. Jul 04 04:14:47.926836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:47.926836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:47.926836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:47.926836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:47.926836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:47.926836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:47.926836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:14:47.926836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:14:47.926836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 04:14:47.926836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 04:14:47.926836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:14:47.926836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:14:47.926836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 04:14:47.926836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:14:47.928108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. Jul 04 04:14:47.928108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:47.928108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:14:47.928108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:47.928108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:14:47.928108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:14:47.928108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:14:47.928108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:14:47.928108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:14:47.928108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. Jul 04 04:14:47.928108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:14:47.928108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a9315aa9-8497-443f-9550-93b21b989332 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] Returning 404 to user: Volume fad02c5c-3171-4046-8d88-36b802f9d0d3 could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:14:47.929789 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a9315aa9-8497-443f-9550-93b21b989332 tempest-VolumesSnapshotsTestJSON-477296401 tempest-VolumesSnapshotsTestJSON-477296401-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fad02c5c-3171-4046-8d88-36b802f9d0d3" status: 404 len: 109 microversion: 2.1 time: 0.081289 Jul 04 04:14:47.929789 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 28/44] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jul 4 04:14:47 2022] GET /compute/v2.1/os-volumes/fad02c5c-3171-4046-8d88-36b802f9d0d3 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:14:48.115054 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-ff7af654-df98-4074-9222-c2a0f4c7e73c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:14:48.116284 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-ff7af654-df98-4074-9222-c2a0f4c7e73c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:14:48.117219 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-ff7af654-df98-4074-9222-c2a0f4c7e73c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:14:48.117778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-ff7af654-df98-4074-9222-c2a0f4c7e73c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:14:48.118416 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-ff7af654-df98-4074-9222-c2a0f4c7e73c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:14:48.133217 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff7af654-df98-4074-9222-c2a0f4c7e73c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:48.134080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff7af654-df98-4074-9222-c2a0f4c7e73c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:48.135460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff7af654-df98-4074-9222-c2a0f4c7e73c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:48.136057 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff7af654-df98-4074-9222-c2a0f4c7e73c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:48.165671 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-ff7af654-df98-4074-9222-c2a0f4c7e73c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Getting quotas for project f14e4e69a2db416caeef8036b55805b6. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:14:48.170680 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-ff7af654-df98-4074-9222-c2a0f4c7e73c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Getting quotas for user 17986e47d6a34cd785ff91f0a000f2b5 and project f14e4e69a2db416caeef8036b55805b6. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:14:48.196424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ff7af654-df98-4074-9222-c2a0f4c7e73c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:14:48.199031 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ff7af654-df98-4074-9222-c2a0f4c7e73c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46b9937d-f997-401a-a3aa-bb9028764454',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:14:48.264646 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ff7af654-df98-4074-9222-c2a0f4c7e73c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.036574 Jul 04 04:14:48.277472 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 17/45] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:14:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 04:14:48.292776 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7693a5b6-a75a-41bf-b63a-e119e72ed075 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:48.293583 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7693a5b6-a75a-41bf-b63a-e119e72ed075 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:48.549605 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7693a5b6-a75a-41bf-b63a-e119e72ed075 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:48.565350 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7693a5b6-a75a-41bf-b63a-e119e72ed075 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1215 microversion: 2.1 time: 0.275951 Jul 04 04:14:48.580877 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 29/46] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:48 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1215 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:48.607197 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2e9cad89-adbf-4261-97fb-acba086c102c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:48.607997 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2e9cad89-adbf-4261-97fb-acba086c102c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:48.622672 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e9cad89-adbf-4261-97fb-acba086c102c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:48.623132 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e9cad89-adbf-4261-97fb-acba086c102c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:48.623938 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e9cad89-adbf-4261-97fb-acba086c102c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:48.624382 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e9cad89-adbf-4261-97fb-acba086c102c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:48.863189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5ad8b436-9d2f-4dc1-b9f3-e5dbc9507c0e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:48.864406 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5ad8b436-9d2f-4dc1-b9f3-e5dbc9507c0e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:48.879512 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5ad8b436-9d2f-4dc1-b9f3-e5dbc9507c0e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:48.880684 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5ad8b436-9d2f-4dc1-b9f3-e5dbc9507c0e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:48.889344 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5ad8b436-9d2f-4dc1-b9f3-e5dbc9507c0e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:48.891746 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5ad8b436-9d2f-4dc1-b9f3-e5dbc9507c0e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:49.282576 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5ad8b436-9d2f-4dc1-b9f3-e5dbc9507c0e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:49.309120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5ad8b436-9d2f-4dc1-b9f3-e5dbc9507c0e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1218 microversion: 2.1 time: 0.451254 Jul 04 04:14:49.320343 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 30/47] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:48 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1218 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:14:49.378093 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2e9cad89-adbf-4261-97fb-acba086c102c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:49.418335 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2e9cad89-adbf-4261-97fb-acba086c102c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1292 microversion: 2.1 time: 0.816610 Jul 04 04:14:49.419793 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 18/48] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:48 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1292 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:49.587768 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5f092060-79b9-48c4-aa66-2936ceb083a4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:49.588346 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5f092060-79b9-48c4-aa66-2936ceb083a4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:49.601952 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5f092060-79b9-48c4-aa66-2936ceb083a4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:49.602471 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5f092060-79b9-48c4-aa66-2936ceb083a4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:49.603298 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5f092060-79b9-48c4-aa66-2936ceb083a4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:49.603861 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5f092060-79b9-48c4-aa66-2936ceb083a4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:50.332074 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-28bfa4af-c58d-4fc5-8ac3-8909b0b445fa tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:50.332074 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-28bfa4af-c58d-4fc5-8ac3-8909b0b445fa tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:50.361908 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28bfa4af-c58d-4fc5-8ac3-8909b0b445fa tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:50.366093 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28bfa4af-c58d-4fc5-8ac3-8909b0b445fa tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:50.367680 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28bfa4af-c58d-4fc5-8ac3-8909b0b445fa tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:50.368921 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28bfa4af-c58d-4fc5-8ac3-8909b0b445fa tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:50.513169 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5f092060-79b9-48c4-aa66-2936ceb083a4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:50.576008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5f092060-79b9-48c4-aa66-2936ceb083a4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1211 microversion: 2.1 time: 0.992588 Jul 04 04:14:50.592189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 31/49] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:49 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1211 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:50.619202 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5aeb26b1-686c-4fb3-9fe3-10295f6b1238 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:50.622098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5aeb26b1-686c-4fb3-9fe3-10295f6b1238 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:50.640994 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5aeb26b1-686c-4fb3-9fe3-10295f6b1238 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:50.641458 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5aeb26b1-686c-4fb3-9fe3-10295f6b1238 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:50.642248 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5aeb26b1-686c-4fb3-9fe3-10295f6b1238 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:50.642716 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5aeb26b1-686c-4fb3-9fe3-10295f6b1238 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:50.950731 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-28bfa4af-c58d-4fc5-8ac3-8909b0b445fa tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:50.964896 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-28bfa4af-c58d-4fc5-8ac3-8909b0b445fa tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1292 microversion: 2.1 time: 0.640583 Jul 04 04:14:50.974460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 19/50] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:50 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1292 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:14:51.117518 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5aeb26b1-686c-4fb3-9fe3-10295f6b1238 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:51.125623 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5aeb26b1-686c-4fb3-9fe3-10295f6b1238 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1298 microversion: 2.1 time: 0.529831 Jul 04 04:14:51.126223 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 32/51] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:50 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1298 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:51.600884 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0f9b3e56-30b3-48ee-8aef-c57db467727f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:51.602742 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0f9b3e56-30b3-48ee-8aef-c57db467727f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:51.664153 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f9b3e56-30b3-48ee-8aef-c57db467727f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:51.672568 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f9b3e56-30b3-48ee-8aef-c57db467727f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:51.673590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f9b3e56-30b3-48ee-8aef-c57db467727f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:51.674104 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f9b3e56-30b3-48ee-8aef-c57db467727f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:52.012194 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-490ca277-22b8-42d0-9d5d-9873bb9d4959 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:52.016706 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-490ca277-22b8-42d0-9d5d-9873bb9d4959 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:52.041317 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-490ca277-22b8-42d0-9d5d-9873bb9d4959 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:52.041800 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-490ca277-22b8-42d0-9d5d-9873bb9d4959 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:52.042696 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-490ca277-22b8-42d0-9d5d-9873bb9d4959 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:52.045821 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-490ca277-22b8-42d0-9d5d-9873bb9d4959 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:52.235021 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-490ca277-22b8-42d0-9d5d-9873bb9d4959 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:52.253089 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-490ca277-22b8-42d0-9d5d-9873bb9d4959 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1280 microversion: 2.1 time: 0.264873 Jul 04 04:14:52.254531 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 33/52] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:51 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1280 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:52.294681 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ef72c6d5-e1a6-40a9-9b1f-6fb2547e65e4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:52.302167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-ef72c6d5-e1a6-40a9-9b1f-6fb2547e65e4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:52.327790 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f9b3e56-30b3-48ee-8aef-c57db467727f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:52.347301 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ef72c6d5-e1a6-40a9-9b1f-6fb2547e65e4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:52.352446 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0f9b3e56-30b3-48ee-8aef-c57db467727f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1273 microversion: 2.1 time: 0.747296 Jul 04 04:14:52.353429 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ef72c6d5-e1a6-40a9-9b1f-6fb2547e65e4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:52.356236 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 20/53] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:51 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1273 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:52.357491 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ef72c6d5-e1a6-40a9-9b1f-6fb2547e65e4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:52.360303 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ef72c6d5-e1a6-40a9-9b1f-6fb2547e65e4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:53.186056 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-ef72c6d5-e1a6-40a9-9b1f-6fb2547e65e4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:53.195045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ef72c6d5-e1a6-40a9-9b1f-6fb2547e65e4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.938948 Jul 04 04:14:53.195808 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 34/54] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:52 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:53.273051 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e0d6e3ee-06d4-44b0-9e96-07b62d25bbb8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:53.273670 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e0d6e3ee-06d4-44b0-9e96-07b62d25bbb8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:53.280233 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0d6e3ee-06d4-44b0-9e96-07b62d25bbb8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:53.285334 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0d6e3ee-06d4-44b0-9e96-07b62d25bbb8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:53.287252 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0d6e3ee-06d4-44b0-9e96-07b62d25bbb8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:53.287702 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0d6e3ee-06d4-44b0-9e96-07b62d25bbb8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:53.376651 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ab00b45d-ced5-4086-82ae-142d62d30cdf tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:53.377908 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-ab00b45d-ced5-4086-82ae-142d62d30cdf tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:53.387321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ab00b45d-ced5-4086-82ae-142d62d30cdf tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:53.388215 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ab00b45d-ced5-4086-82ae-142d62d30cdf tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:53.389511 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ab00b45d-ced5-4086-82ae-142d62d30cdf tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:53.390131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ab00b45d-ced5-4086-82ae-142d62d30cdf tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:53.406467 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e0d6e3ee-06d4-44b0-9e96-07b62d25bbb8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:53.414855 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e0d6e3ee-06d4-44b0-9e96-07b62d25bbb8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1280 microversion: 2.1 time: 0.146688 Jul 04 04:14:53.415439 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 21/55] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:53 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1280 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:53.514360 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-ab00b45d-ced5-4086-82ae-142d62d30cdf tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:53.527845 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ab00b45d-ced5-4086-82ae-142d62d30cdf tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1273 microversion: 2.1 time: 0.158169 Jul 04 04:14:53.540257 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 35/56] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:53 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1273 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:14:54.213304 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9f60ee27-8bc7-4c47-b0d4-496e38449379 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:54.214431 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9f60ee27-8bc7-4c47-b0d4-496e38449379 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:54.227401 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f60ee27-8bc7-4c47-b0d4-496e38449379 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:54.228971 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f60ee27-8bc7-4c47-b0d4-496e38449379 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:54.232157 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f60ee27-8bc7-4c47-b0d4-496e38449379 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:54.233035 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f60ee27-8bc7-4c47-b0d4-496e38449379 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:54.431756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-79deb503-9c67-4cd8-9b03-72b1d7a65a4a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:54.434177 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-79deb503-9c67-4cd8-9b03-72b1d7a65a4a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:54.448770 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-79deb503-9c67-4cd8-9b03-72b1d7a65a4a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:54.453983 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9f60ee27-8bc7-4c47-b0d4-496e38449379 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:54.463405 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9f60ee27-8bc7-4c47-b0d4-496e38449379 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.255018 Jul 04 04:14:54.464003 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 22/57] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:54 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:54.467525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-79deb503-9c67-4cd8-9b03-72b1d7a65a4a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:54.469429 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-79deb503-9c67-4cd8-9b03-72b1d7a65a4a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:54.470283 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-79deb503-9c67-4cd8-9b03-72b1d7a65a4a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:54.554116 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f0748e86-f9b1-4081-91a8-70cc6e9744a2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:54.554770 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f0748e86-f9b1-4081-91a8-70cc6e9744a2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:54.574659 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0748e86-f9b1-4081-91a8-70cc6e9744a2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:54.575158 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0748e86-f9b1-4081-91a8-70cc6e9744a2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:54.576002 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0748e86-f9b1-4081-91a8-70cc6e9744a2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:54.576467 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0748e86-f9b1-4081-91a8-70cc6e9744a2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:54.735900 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f0748e86-f9b1-4081-91a8-70cc6e9744a2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:54.759626 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f0748e86-f9b1-4081-91a8-70cc6e9744a2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1273 microversion: 2.1 time: 0.212376 Jul 04 04:14:54.762823 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 23/58] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:54 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1273 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:54.836141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-79deb503-9c67-4cd8-9b03-72b1d7a65a4a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:54.847498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-79deb503-9c67-4cd8-9b03-72b1d7a65a4a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.419647 Jul 04 04:14:54.857006 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 36/59] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:54 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:14:55.481438 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c2e76b29-39d5-4a81-9919-b5c6fa8aafdb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:55.482164 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c2e76b29-39d5-4a81-9919-b5c6fa8aafdb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:55.488545 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2e76b29-39d5-4a81-9919-b5c6fa8aafdb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:55.489235 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2e76b29-39d5-4a81-9919-b5c6fa8aafdb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:55.490003 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2e76b29-39d5-4a81-9919-b5c6fa8aafdb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:55.490457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2e76b29-39d5-4a81-9919-b5c6fa8aafdb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:55.665151 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c2e76b29-39d5-4a81-9919-b5c6fa8aafdb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:55.674429 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c2e76b29-39d5-4a81-9919-b5c6fa8aafdb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.197941 Jul 04 04:14:55.676236 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 24/60] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:55 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:55.782805 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-38d97ac7-946e-4975-b9a9-b269ce071009 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:55.784766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-38d97ac7-946e-4975-b9a9-b269ce071009 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:55.793108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-38d97ac7-946e-4975-b9a9-b269ce071009 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:55.793661 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-38d97ac7-946e-4975-b9a9-b269ce071009 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:55.794936 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-38d97ac7-946e-4975-b9a9-b269ce071009 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:55.804327 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-38d97ac7-946e-4975-b9a9-b269ce071009 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:55.865356 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6c787684-85ba-467a-bdf2-fe21ec6bbb73 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:55.866048 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6c787684-85ba-467a-bdf2-fe21ec6bbb73 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:55.880255 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c787684-85ba-467a-bdf2-fe21ec6bbb73 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:55.880703 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c787684-85ba-467a-bdf2-fe21ec6bbb73 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:55.881490 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c787684-85ba-467a-bdf2-fe21ec6bbb73 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:55.882538 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c787684-85ba-467a-bdf2-fe21ec6bbb73 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:55.918867 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-38d97ac7-946e-4975-b9a9-b269ce071009 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:55.934192 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-38d97ac7-946e-4975-b9a9-b269ce071009 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1273 microversion: 2.1 time: 0.160473 Jul 04 04:14:55.934921 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 37/61] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:55 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:56.140175 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6c787684-85ba-467a-bdf2-fe21ec6bbb73 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:56.148880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6c787684-85ba-467a-bdf2-fe21ec6bbb73 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.288297 Jul 04 04:14:56.160235 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 25/62] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:55 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:56.693915 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-951c0dac-59de-40f5-8b8c-876ce05239f7 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:56.694932 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-951c0dac-59de-40f5-8b8c-876ce05239f7 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:56.701440 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-951c0dac-59de-40f5-8b8c-876ce05239f7 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:56.702404 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-951c0dac-59de-40f5-8b8c-876ce05239f7 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:56.703478 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-951c0dac-59de-40f5-8b8c-876ce05239f7 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:56.704208 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-951c0dac-59de-40f5-8b8c-876ce05239f7 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:56.902305 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-951c0dac-59de-40f5-8b8c-876ce05239f7 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:56.911723 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-951c0dac-59de-40f5-8b8c-876ce05239f7 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.222154 Jul 04 04:14:56.912317 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 38/63] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:56 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:14:56.957573 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-608f4e80-50f3-4171-a739-3aeaca73fa97 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:56.959643 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-608f4e80-50f3-4171-a739-3aeaca73fa97 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:56.969421 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-608f4e80-50f3-4171-a739-3aeaca73fa97 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:56.970873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-608f4e80-50f3-4171-a739-3aeaca73fa97 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:56.972287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-608f4e80-50f3-4171-a739-3aeaca73fa97 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:56.972970 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-608f4e80-50f3-4171-a739-3aeaca73fa97 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:57.048021 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-608f4e80-50f3-4171-a739-3aeaca73fa97 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:57.057281 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-608f4e80-50f3-4171-a739-3aeaca73fa97 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1273 microversion: 2.1 time: 0.108706 Jul 04 04:14:57.058510 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 26/64] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:56 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1273 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:57.173180 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-edc90da1-5e88-4fe1-827b-e542eedf76da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:57.176787 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-edc90da1-5e88-4fe1-827b-e542eedf76da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:57.185034 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=2 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:14:57.187143 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-edc90da1-5e88-4fe1-827b-e542eedf76da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:57.188021 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-edc90da1-5e88-4fe1-827b-e542eedf76da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:57.189035 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-edc90da1-5e88-4fe1-827b-e542eedf76da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:57.189689 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-edc90da1-5e88-4fe1-827b-e542eedf76da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:57.394153 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-edc90da1-5e88-4fe1-827b-e542eedf76da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:57.406083 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-edc90da1-5e88-4fe1-827b-e542eedf76da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.242295 Jul 04 04:14:57.407046 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 39/65] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:57 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:57.541881 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-afaae751-5c8d-4121-af2d-a21067b401af tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] Calling method '.version_select at 0x7f50c1ceb310>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:57.933357 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-36d4b64f-00ab-48d0-8123-59128d486c5a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:57.933990 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-36d4b64f-00ab-48d0-8123-59128d486c5a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:57.935344 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-afaae751-5c8d-4121-af2d-a21067b401af tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8db67c7e-a652-41b8-a9cd-1ac44056e659" status: 200 len: 351 microversion: 2.1 time: 0.394792 Jul 04 04:14:57.936106 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 27/66] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jul 4 04:14:57 2022] GET /compute/v2.1/os-volumes/8db67c7e-a652-41b8-a9cd-1ac44056e659 => generated 351 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:14:57.941908 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-36d4b64f-00ab-48d0-8123-59128d486c5a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:57.942810 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-36d4b64f-00ab-48d0-8123-59128d486c5a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:57.943841 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-36d4b64f-00ab-48d0-8123-59128d486c5a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:57.944263 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-36d4b64f-00ab-48d0-8123-59128d486c5a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:58.077592 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-64614924-7f68-4816-aa2e-f51487ed82fc tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:58.078352 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-64614924-7f68-4816-aa2e-f51487ed82fc tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:58.090064 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64614924-7f68-4816-aa2e-f51487ed82fc tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:58.090464 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64614924-7f68-4816-aa2e-f51487ed82fc tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:58.093541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64614924-7f68-4816-aa2e-f51487ed82fc tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:58.094745 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64614924-7f68-4816-aa2e-f51487ed82fc tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:58.141060 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-36d4b64f-00ab-48d0-8123-59128d486c5a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:58.151134 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-36d4b64f-00ab-48d0-8123-59128d486c5a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.224917 Jul 04 04:14:58.152327 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 40/67] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:57 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:58.181726 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=6 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:14:58.184493 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=20 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:14:58.423763 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-88dd23d7-35ff-4c11-9dc2-abe72f2dac75 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:58.424898 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-88dd23d7-35ff-4c11-9dc2-abe72f2dac75 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:58.433138 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-88dd23d7-35ff-4c11-9dc2-abe72f2dac75 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:58.433729 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-88dd23d7-35ff-4c11-9dc2-abe72f2dac75 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:58.434891 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-88dd23d7-35ff-4c11-9dc2-abe72f2dac75 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:58.435481 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-88dd23d7-35ff-4c11-9dc2-abe72f2dac75 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:58.467772 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-64614924-7f68-4816-aa2e-f51487ed82fc tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:58.480340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-64614924-7f68-4816-aa2e-f51487ed82fc tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1273 microversion: 2.1 time: 0.408851 Jul 04 04:14:58.481155 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 28/68] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:58 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1273 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:58.556619 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=16 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:14:58.734912 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-88dd23d7-35ff-4c11-9dc2-abe72f2dac75 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:58.747629 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-88dd23d7-35ff-4c11-9dc2-abe72f2dac75 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.327576 Jul 04 04:14:58.748214 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 41/69] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:58 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:14:59.168699 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a7b315e4-124f-4a1d-b84e-6a16f152346f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:59.169286 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a7b315e4-124f-4a1d-b84e-6a16f152346f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:59.175643 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=9 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:14:59.177361 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7b315e4-124f-4a1d-b84e-6a16f152346f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:59.177949 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7b315e4-124f-4a1d-b84e-6a16f152346f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:59.178856 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7b315e4-124f-4a1d-b84e-6a16f152346f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:59.179437 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7b315e4-124f-4a1d-b84e-6a16f152346f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:59.361865 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a7b315e4-124f-4a1d-b84e-6a16f152346f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:59.370955 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a7b315e4-124f-4a1d-b84e-6a16f152346f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.205619 Jul 04 04:14:59.381142 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 29/70] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:59 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:59.498321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5147ddb5-af7c-4fb1-8e2c-1bf4980685df tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:59.499262 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5147ddb5-af7c-4fb1-8e2c-1bf4980685df tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:59.506147 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5147ddb5-af7c-4fb1-8e2c-1bf4980685df tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:59.506638 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5147ddb5-af7c-4fb1-8e2c-1bf4980685df tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:59.508032 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5147ddb5-af7c-4fb1-8e2c-1bf4980685df tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:59.508471 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5147ddb5-af7c-4fb1-8e2c-1bf4980685df tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:59.574517 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5147ddb5-af7c-4fb1-8e2c-1bf4980685df tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:59.583032 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5147ddb5-af7c-4fb1-8e2c-1bf4980685df tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1273 microversion: 2.1 time: 0.089064 Jul 04 04:14:59.583800 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 42/71] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:59 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:14:59.765464 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6fe5e0d4-c21d-4cc8-8079-c3c6657d8a0b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:14:59.766062 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6fe5e0d4-c21d-4cc8-8079-c3c6657d8a0b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:14:59.772689 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6fe5e0d4-c21d-4cc8-8079-c3c6657d8a0b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:59.773482 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6fe5e0d4-c21d-4cc8-8079-c3c6657d8a0b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:59.774505 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6fe5e0d4-c21d-4cc8-8079-c3c6657d8a0b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:14:59.775152 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6fe5e0d4-c21d-4cc8-8079-c3c6657d8a0b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:14:59.927846 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6fe5e0d4-c21d-4cc8-8079-c3c6657d8a0b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:14:59.936186 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6fe5e0d4-c21d-4cc8-8079-c3c6657d8a0b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.175059 Jul 04 04:14:59.936786 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 30/72] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:14:59 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:00.391584 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-23a1e7bb-14e2-425e-ae50-89b7bb45ccb0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:00.392234 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-23a1e7bb-14e2-425e-ae50-89b7bb45ccb0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:00.399311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-23a1e7bb-14e2-425e-ae50-89b7bb45ccb0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:00.399789 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-23a1e7bb-14e2-425e-ae50-89b7bb45ccb0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:00.400550 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-23a1e7bb-14e2-425e-ae50-89b7bb45ccb0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:00.400983 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-23a1e7bb-14e2-425e-ae50-89b7bb45ccb0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:00.536664 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-23a1e7bb-14e2-425e-ae50-89b7bb45ccb0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:00.545786 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-23a1e7bb-14e2-425e-ae50-89b7bb45ccb0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.160596 Jul 04 04:15:00.546398 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 43/73] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:00 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:00.600264 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f62dc924-a2db-42ca-a7e9-5a7ca97a70ee tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:00.600979 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f62dc924-a2db-42ca-a7e9-5a7ca97a70ee tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:00.607632 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f62dc924-a2db-42ca-a7e9-5a7ca97a70ee tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:00.608084 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f62dc924-a2db-42ca-a7e9-5a7ca97a70ee tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:00.608830 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f62dc924-a2db-42ca-a7e9-5a7ca97a70ee tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:00.609258 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f62dc924-a2db-42ca-a7e9-5a7ca97a70ee tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:00.672616 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f62dc924-a2db-42ca-a7e9-5a7ca97a70ee tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:00.680388 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f62dc924-a2db-42ca-a7e9-5a7ca97a70ee tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1273 microversion: 2.1 time: 0.084057 Jul 04 04:15:00.680949 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 31/74] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:00 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:00.957465 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-6f718731-9e55-4e88-8f83-46e3455ff9c5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:00.957992 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-6f718731-9e55-4e88-8f83-46e3455ff9c5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:00.967334 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6f718731-9e55-4e88-8f83-46e3455ff9c5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:00.967940 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6f718731-9e55-4e88-8f83-46e3455ff9c5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:00.968955 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6f718731-9e55-4e88-8f83-46e3455ff9c5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:00.969493 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6f718731-9e55-4e88-8f83-46e3455ff9c5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:01.122021 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-6f718731-9e55-4e88-8f83-46e3455ff9c5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:01.129772 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-6f718731-9e55-4e88-8f83-46e3455ff9c5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.179277 Jul 04 04:15:01.130393 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 44/75] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:00 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:01.566299 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0688b93b-41ae-4766-a5e2-b975fe1bf859 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:01.566933 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0688b93b-41ae-4766-a5e2-b975fe1bf859 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:01.573612 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0688b93b-41ae-4766-a5e2-b975fe1bf859 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:01.574051 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0688b93b-41ae-4766-a5e2-b975fe1bf859 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:01.574852 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0688b93b-41ae-4766-a5e2-b975fe1bf859 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:01.575280 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0688b93b-41ae-4766-a5e2-b975fe1bf859 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:01.700234 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-076e9a74-e457-48cb-ab8e-7bca45a86242 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:01.701445 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-076e9a74-e457-48cb-ab8e-7bca45a86242 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:01.711346 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-076e9a74-e457-48cb-ab8e-7bca45a86242 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:01.712175 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-076e9a74-e457-48cb-ab8e-7bca45a86242 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:01.713531 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-076e9a74-e457-48cb-ab8e-7bca45a86242 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:01.714291 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-076e9a74-e457-48cb-ab8e-7bca45a86242 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:01.727612 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0688b93b-41ae-4766-a5e2-b975fe1bf859 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:01.736377 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0688b93b-41ae-4766-a5e2-b975fe1bf859 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.173969 Jul 04 04:15:01.737293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 32/76] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:01 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:01.800386 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-076e9a74-e457-48cb-ab8e-7bca45a86242 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:01.807976 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-076e9a74-e457-48cb-ab8e-7bca45a86242 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1273 microversion: 2.1 time: 0.114292 Jul 04 04:15:01.808548 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 45/77] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:01 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1273 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:02.148788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b1efab21-a647-45da-aa6a-ffc0483b9043 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:02.149461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b1efab21-a647-45da-aa6a-ffc0483b9043 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:02.156228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1efab21-a647-45da-aa6a-ffc0483b9043 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:02.156674 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1efab21-a647-45da-aa6a-ffc0483b9043 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:02.157493 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1efab21-a647-45da-aa6a-ffc0483b9043 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:02.157951 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1efab21-a647-45da-aa6a-ffc0483b9043 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:02.307704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b1efab21-a647-45da-aa6a-ffc0483b9043 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:02.315906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b1efab21-a647-45da-aa6a-ffc0483b9043 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.171554 Jul 04 04:15:02.316667 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 33/78] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:02 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:02.753150 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-69cc87a9-2e02-4722-add0-1195857e57a0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:02.753744 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-69cc87a9-2e02-4722-add0-1195857e57a0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:02.760156 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-69cc87a9-2e02-4722-add0-1195857e57a0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:02.760609 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-69cc87a9-2e02-4722-add0-1195857e57a0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:02.761369 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-69cc87a9-2e02-4722-add0-1195857e57a0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:02.761798 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-69cc87a9-2e02-4722-add0-1195857e57a0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:02.766027 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=100 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:02.827000 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ccecf1d5-f394-4218-92e6-e86e2e3ea8d9 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:02.827647 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ccecf1d5-f394-4218-92e6-e86e2e3ea8d9 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:02.833817 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ccecf1d5-f394-4218-92e6-e86e2e3ea8d9 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:02.834251 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ccecf1d5-f394-4218-92e6-e86e2e3ea8d9 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:02.835141 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ccecf1d5-f394-4218-92e6-e86e2e3ea8d9 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:02.835568 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ccecf1d5-f394-4218-92e6-e86e2e3ea8d9 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:02.854140 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:02.900398 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ccecf1d5-f394-4218-92e6-e86e2e3ea8d9 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:02.908001 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ccecf1d5-f394-4218-92e6-e86e2e3ea8d9 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1273 microversion: 2.1 time: 0.084856 Jul 04 04:15:02.908555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 34/79] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:02 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:02.933557 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-69cc87a9-2e02-4722-add0-1195857e57a0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:02.941197 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-69cc87a9-2e02-4722-add0-1195857e57a0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.191938 Jul 04 04:15:02.941858 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 46/80] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:02 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:03.334715 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d2bf39d9-14f4-4c83-85d5-39a22a82aa68 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:03.335661 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d2bf39d9-14f4-4c83-85d5-39a22a82aa68 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:03.342542 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2bf39d9-14f4-4c83-85d5-39a22a82aa68 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:03.343032 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2bf39d9-14f4-4c83-85d5-39a22a82aa68 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:03.343875 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2bf39d9-14f4-4c83-85d5-39a22a82aa68 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:03.344375 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2bf39d9-14f4-4c83-85d5-39a22a82aa68 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:03.502691 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d2bf39d9-14f4-4c83-85d5-39a22a82aa68 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:03.520563 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d2bf39d9-14f4-4c83-85d5-39a22a82aa68 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.189443 Jul 04 04:15:03.521521 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 35/81] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:03 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:03.930742 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-532d5425-3114-4cd7-9074-e242b2ba5e4f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:03.931749 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-532d5425-3114-4cd7-9074-e242b2ba5e4f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:03.941059 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-532d5425-3114-4cd7-9074-e242b2ba5e4f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:03.941734 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-532d5425-3114-4cd7-9074-e242b2ba5e4f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:03.942912 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-532d5425-3114-4cd7-9074-e242b2ba5e4f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:03.943562 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-532d5425-3114-4cd7-9074-e242b2ba5e4f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:03.963398 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2bb43a68-7d16-4c60-8541-49d3969c0c52 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:03.964910 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2bb43a68-7d16-4c60-8541-49d3969c0c52 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:03.972037 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2bb43a68-7d16-4c60-8541-49d3969c0c52 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:03.979218 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2bb43a68-7d16-4c60-8541-49d3969c0c52 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:03.980332 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2bb43a68-7d16-4c60-8541-49d3969c0c52 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:03.981047 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2bb43a68-7d16-4c60-8541-49d3969c0c52 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:04.019344 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-532d5425-3114-4cd7-9074-e242b2ba5e4f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:04.038812 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-532d5425-3114-4cd7-9074-e242b2ba5e4f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1273 microversion: 2.1 time: 0.114432 Jul 04 04:15:04.039376 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 47/82] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:03 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1273 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:04.145990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2bb43a68-7d16-4c60-8541-49d3969c0c52 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:04.154998 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2bb43a68-7d16-4c60-8541-49d3969c0c52 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.198350 Jul 04 04:15:04.165164 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 36/83] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:03 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:04.541904 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9656a9fe-6760-40a1-95bd-4ec30062cb9f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:04.542539 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-9656a9fe-6760-40a1-95bd-4ec30062cb9f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:04.549306 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9656a9fe-6760-40a1-95bd-4ec30062cb9f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:04.549747 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9656a9fe-6760-40a1-95bd-4ec30062cb9f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:04.550535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9656a9fe-6760-40a1-95bd-4ec30062cb9f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:04.550963 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9656a9fe-6760-40a1-95bd-4ec30062cb9f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:04.816530 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9656a9fe-6760-40a1-95bd-4ec30062cb9f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:04.824902 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9656a9fe-6760-40a1-95bd-4ec30062cb9f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.287231 Jul 04 04:15:04.825476 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 48/84] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:04 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:05.060681 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4a9ba058-fb1b-410a-9acd-faa390a61196 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:05.061535 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4a9ba058-fb1b-410a-9acd-faa390a61196 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:05.072280 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a9ba058-fb1b-410a-9acd-faa390a61196 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:05.073021 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a9ba058-fb1b-410a-9acd-faa390a61196 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:05.074427 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a9ba058-fb1b-410a-9acd-faa390a61196 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:05.075148 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a9ba058-fb1b-410a-9acd-faa390a61196 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:05.142401 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4a9ba058-fb1b-410a-9acd-faa390a61196 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:05.150644 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4a9ba058-fb1b-410a-9acd-faa390a61196 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1273 microversion: 2.1 time: 0.096732 Jul 04 04:15:05.151223 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 37/85] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:05 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1273 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:05.172735 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c724cbf0-062d-4756-8fe7-18f3e0fd10b3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:05.173355 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c724cbf0-062d-4756-8fe7-18f3e0fd10b3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:05.179998 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c724cbf0-062d-4756-8fe7-18f3e0fd10b3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:05.180444 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c724cbf0-062d-4756-8fe7-18f3e0fd10b3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:05.181212 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c724cbf0-062d-4756-8fe7-18f3e0fd10b3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:05.181646 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c724cbf0-062d-4756-8fe7-18f3e0fd10b3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:05.317703 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c724cbf0-062d-4756-8fe7-18f3e0fd10b3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:05.325925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c724cbf0-062d-4756-8fe7-18f3e0fd10b3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.157225 Jul 04 04:15:05.326527 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 49/86] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:05 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:05.849167 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-98a7c67d-0687-4d37-8ea5-cb2b9dcbc349 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:05.849998 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-98a7c67d-0687-4d37-8ea5-cb2b9dcbc349 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:05.859876 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98a7c67d-0687-4d37-8ea5-cb2b9dcbc349 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:05.860515 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98a7c67d-0687-4d37-8ea5-cb2b9dcbc349 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:05.861745 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98a7c67d-0687-4d37-8ea5-cb2b9dcbc349 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:05.862440 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-98a7c67d-0687-4d37-8ea5-cb2b9dcbc349 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:05.992852 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-98a7c67d-0687-4d37-8ea5-cb2b9dcbc349 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:06.000359 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-98a7c67d-0687-4d37-8ea5-cb2b9dcbc349 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.157595 Jul 04 04:15:06.000931 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 38/87] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:05 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:06.178053 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-04b186a6-4d0c-4bb3-8818-907139d27efd tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:06.178934 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-04b186a6-4d0c-4bb3-8818-907139d27efd tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:06.185113 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-04b186a6-4d0c-4bb3-8818-907139d27efd tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:06.185564 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-04b186a6-4d0c-4bb3-8818-907139d27efd tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:06.186903 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-04b186a6-4d0c-4bb3-8818-907139d27efd tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:06.187614 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-04b186a6-4d0c-4bb3-8818-907139d27efd tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:06.258613 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-04b186a6-4d0c-4bb3-8818-907139d27efd tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:06.267188 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-04b186a6-4d0c-4bb3-8818-907139d27efd tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1273 microversion: 2.1 time: 0.099451 Jul 04 04:15:06.268074 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 50/88] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:06 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:06.343337 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0ce6fa7a-4553-45d7-a34e-2e1dd1f76fb0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:06.344162 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0ce6fa7a-4553-45d7-a34e-2e1dd1f76fb0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:06.351292 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ce6fa7a-4553-45d7-a34e-2e1dd1f76fb0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:06.351292 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ce6fa7a-4553-45d7-a34e-2e1dd1f76fb0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:06.351848 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ce6fa7a-4553-45d7-a34e-2e1dd1f76fb0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:06.352279 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ce6fa7a-4553-45d7-a34e-2e1dd1f76fb0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:06.568768 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0ce6fa7a-4553-45d7-a34e-2e1dd1f76fb0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:06.578594 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0ce6fa7a-4553-45d7-a34e-2e1dd1f76fb0 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.238945 Jul 04 04:15:06.579497 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 39/89] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:06 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:07.020126 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-2b19fbae-94e9-4c21-996b-554b7779af5c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:07.020846 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-2b19fbae-94e9-4c21-996b-554b7779af5c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:07.027786 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2b19fbae-94e9-4c21-996b-554b7779af5c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:07.028231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2b19fbae-94e9-4c21-996b-554b7779af5c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:07.029021 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2b19fbae-94e9-4c21-996b-554b7779af5c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:07.029453 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2b19fbae-94e9-4c21-996b-554b7779af5c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:07.158911 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-2b19fbae-94e9-4c21-996b-554b7779af5c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:07.169886 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-2b19fbae-94e9-4c21-996b-554b7779af5c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.154914 Jul 04 04:15:07.170697 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 51/90] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:07 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:07.289472 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5e05776e-93b9-46a8-aeb1-42045938616f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:07.290349 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5e05776e-93b9-46a8-aeb1-42045938616f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:07.300829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e05776e-93b9-46a8-aeb1-42045938616f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:07.301143 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e05776e-93b9-46a8-aeb1-42045938616f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:07.302419 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e05776e-93b9-46a8-aeb1-42045938616f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:07.303136 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e05776e-93b9-46a8-aeb1-42045938616f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:07.438348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5e05776e-93b9-46a8-aeb1-42045938616f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:07.447815 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5e05776e-93b9-46a8-aeb1-42045938616f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.165299 Jul 04 04:15:07.448382 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 40/91] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:07 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:07.596207 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ce4448f4-eb76-4c4a-9dc6-cad7589c9981 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:07.596949 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-ce4448f4-eb76-4c4a-9dc6-cad7589c9981 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:07.603620 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ce4448f4-eb76-4c4a-9dc6-cad7589c9981 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:07.604065 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ce4448f4-eb76-4c4a-9dc6-cad7589c9981 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:07.604811 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ce4448f4-eb76-4c4a-9dc6-cad7589c9981 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:07.605246 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ce4448f4-eb76-4c4a-9dc6-cad7589c9981 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:07.739673 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-ce4448f4-eb76-4c4a-9dc6-cad7589c9981 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:07.750658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ce4448f4-eb76-4c4a-9dc6-cad7589c9981 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.158292 Jul 04 04:15:07.751247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 52/92] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:07 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:08.194095 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-60913bb2-59b6-489d-b69e-b37370e60fc9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:08.195135 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-60913bb2-59b6-489d-b69e-b37370e60fc9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:08.202300 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60913bb2-59b6-489d-b69e-b37370e60fc9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:08.202777 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60913bb2-59b6-489d-b69e-b37370e60fc9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:08.203525 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60913bb2-59b6-489d-b69e-b37370e60fc9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:08.203953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60913bb2-59b6-489d-b69e-b37370e60fc9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:08.341211 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-60913bb2-59b6-489d-b69e-b37370e60fc9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:08.348690 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-60913bb2-59b6-489d-b69e-b37370e60fc9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.161109 Jul 04 04:15:08.349253 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 41/93] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:08 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:08.468165 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b0fee39b-dab5-4c75-98fd-78abb7b8f3b3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:08.468698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b0fee39b-dab5-4c75-98fd-78abb7b8f3b3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:08.475136 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b0fee39b-dab5-4c75-98fd-78abb7b8f3b3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:08.475560 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b0fee39b-dab5-4c75-98fd-78abb7b8f3b3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:08.476321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b0fee39b-dab5-4c75-98fd-78abb7b8f3b3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:08.476755 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b0fee39b-dab5-4c75-98fd-78abb7b8f3b3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:08.609742 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b0fee39b-dab5-4c75-98fd-78abb7b8f3b3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:08.617669 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b0fee39b-dab5-4c75-98fd-78abb7b8f3b3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.153495 Jul 04 04:15:08.618253 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 53/94] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:08 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:08.772919 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cd1bd172-ae21-4f8e-9eb8-021de7fd1aa5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:08.773521 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cd1bd172-ae21-4f8e-9eb8-021de7fd1aa5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:08.780070 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd1bd172-ae21-4f8e-9eb8-021de7fd1aa5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:08.780522 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd1bd172-ae21-4f8e-9eb8-021de7fd1aa5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:08.781282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd1bd172-ae21-4f8e-9eb8-021de7fd1aa5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:08.781715 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd1bd172-ae21-4f8e-9eb8-021de7fd1aa5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:08.921545 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cd1bd172-ae21-4f8e-9eb8-021de7fd1aa5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:08.929665 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cd1bd172-ae21-4f8e-9eb8-021de7fd1aa5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.160708 Jul 04 04:15:08.930238 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 42/95] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:08 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:09.368976 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7131ef42-10ee-4ec3-a1b9-4e93dfcf99b2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:09.370261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7131ef42-10ee-4ec3-a1b9-4e93dfcf99b2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:09.372958 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:09.382274 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7131ef42-10ee-4ec3-a1b9-4e93dfcf99b2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:09.383006 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7131ef42-10ee-4ec3-a1b9-4e93dfcf99b2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:09.384203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7131ef42-10ee-4ec3-a1b9-4e93dfcf99b2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:09.384867 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7131ef42-10ee-4ec3-a1b9-4e93dfcf99b2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:09.531540 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7131ef42-10ee-4ec3-a1b9-4e93dfcf99b2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:09.543127 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7131ef42-10ee-4ec3-a1b9-4e93dfcf99b2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.180486 Jul 04 04:15:09.543673 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 54/96] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:09 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:09.639530 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-83822584-3371-4b82-80f9-5d8a08c6aa4e tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:09.640399 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-83822584-3371-4b82-80f9-5d8a08c6aa4e tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:09.650473 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83822584-3371-4b82-80f9-5d8a08c6aa4e tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:09.651176 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83822584-3371-4b82-80f9-5d8a08c6aa4e tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:09.651937 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83822584-3371-4b82-80f9-5d8a08c6aa4e tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:09.652368 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83822584-3371-4b82-80f9-5d8a08c6aa4e tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:09.800622 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-83822584-3371-4b82-80f9-5d8a08c6aa4e tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:09.808362 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-83822584-3371-4b82-80f9-5d8a08c6aa4e tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.175787 Jul 04 04:15:09.808919 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 43/97] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:09 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:09.951891 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f50baad9-866a-40d8-9509-ed9d37ac08b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:09.952938 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f50baad9-866a-40d8-9509-ed9d37ac08b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:09.963632 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f50baad9-866a-40d8-9509-ed9d37ac08b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:09.964155 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f50baad9-866a-40d8-9509-ed9d37ac08b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:09.964911 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f50baad9-866a-40d8-9509-ed9d37ac08b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:09.965339 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f50baad9-866a-40d8-9509-ed9d37ac08b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:10.101002 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f50baad9-866a-40d8-9509-ed9d37ac08b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:10.109028 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-f50baad9-866a-40d8-9509-ed9d37ac08b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.163976 Jul 04 04:15:10.109595 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 55/98] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:09 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:10.561348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e9d3bed2-c200-44fc-8e23-d903694d8d76 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:10.561972 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e9d3bed2-c200-44fc-8e23-d903694d8d76 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:10.572376 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9d3bed2-c200-44fc-8e23-d903694d8d76 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:10.575206 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9d3bed2-c200-44fc-8e23-d903694d8d76 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:10.576953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9d3bed2-c200-44fc-8e23-d903694d8d76 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:10.577462 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9d3bed2-c200-44fc-8e23-d903694d8d76 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:10.825079 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d9f530e7-6656-4c4f-a878-f6c465c208ad tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:10.825694 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d9f530e7-6656-4c4f-a878-f6c465c208ad tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:10.841184 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d9f530e7-6656-4c4f-a878-f6c465c208ad tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:10.845477 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d9f530e7-6656-4c4f-a878-f6c465c208ad tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:10.846277 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d9f530e7-6656-4c4f-a878-f6c465c208ad tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:10.846735 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d9f530e7-6656-4c4f-a878-f6c465c208ad tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:10.937076 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e9d3bed2-c200-44fc-8e23-d903694d8d76 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:10.945028 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e9d3bed2-c200-44fc-8e23-d903694d8d76 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.388616 Jul 04 04:15:10.945883 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 44/99] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:10 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:11.050125 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d9f530e7-6656-4c4f-a878-f6c465c208ad tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:11.059819 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d9f530e7-6656-4c4f-a878-f6c465c208ad tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.238703 Jul 04 04:15:11.061271 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 56/100] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:10 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:11.127247 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f1996503-a7b0-4d8b-9425-58aaa422c9a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:11.128214 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f1996503-a7b0-4d8b-9425-58aaa422c9a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:11.135130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1996503-a7b0-4d8b-9425-58aaa422c9a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:11.135792 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1996503-a7b0-4d8b-9425-58aaa422c9a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:11.137684 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1996503-a7b0-4d8b-9425-58aaa422c9a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:11.138649 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1996503-a7b0-4d8b-9425-58aaa422c9a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:11.754692 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-d89f5a3d-1381-4c07-ac02-3d7336a2e7c0 req-31cc0723-ce4d-4764-a7ed-0c3693587a41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "314d0a92-11cc-45ac-b70b-1c65f66ecfc4", "tag": "0de8d78e-8696-4840-bc1b-e94f52bb4eb1"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:15:11.770298 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-d89f5a3d-1381-4c07-ac02-3d7336a2e7c0 req-31cc0723-ce4d-4764-a7ed-0c3693587a41 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:11.770939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-d89f5a3d-1381-4c07-ac02-3d7336a2e7c0 req-31cc0723-ce4d-4764-a7ed-0c3693587a41 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:11.775352 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f1996503-a7b0-4d8b-9425-58aaa422c9a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:11.789517 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f1996503-a7b0-4d8b-9425-58aaa422c9a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.667445 Jul 04 04:15:11.790469 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 45/101] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:11 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:11.805013 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-d89f5a3d-1381-4c07-ac02-3d7336a2e7c0 req-31cc0723-ce4d-4764-a7ed-0c3693587a41 service nova] Creating event network-changed:0de8d78e-8696-4840-bc1b-e94f52bb4eb1 for instance 314d0a92-11cc-45ac-b70b-1c65f66ecfc4 on hv-cinder-74216 Jul 04 04:15:11.805540 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-d89f5a3d-1381-4c07-ac02-3d7336a2e7c0 req-31cc0723-ce4d-4764-a7ed-0c3693587a41 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 04 04:15:11.806664 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e61b201f-7744-4061-9fc7-52cb88effe2d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:11.807572 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e61b201f-7744-4061-9fc7-52cb88effe2d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:11.808600 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e61b201f-7744-4061-9fc7-52cb88effe2d None None] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:11.809223 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e61b201f-7744-4061-9fc7-52cb88effe2d None None] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:11.820169 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.compute.rpcapi [None req-e61b201f-7744-4061-9fc7-52cb88effe2d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 04 04:15:11.821149 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e61b201f-7744-4061-9fc7-52cb88effe2d None None] Releasing lock "compute-rpcapi-router" {{(pid=117875) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 04 04:15:11.837737 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e61b201f-7744-4061-9fc7-52cb88effe2d None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161009 Jul 04 04:15:11.838461 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 57/102] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:15:11.962315 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5e716f2b-0267-4ddd-b2ef-f973b82b0b7d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:11.963193 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5e716f2b-0267-4ddd-b2ef-f973b82b0b7d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:11.971003 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e716f2b-0267-4ddd-b2ef-f973b82b0b7d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:11.971681 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e716f2b-0267-4ddd-b2ef-f973b82b0b7d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:11.972542 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e716f2b-0267-4ddd-b2ef-f973b82b0b7d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:11.973321 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e716f2b-0267-4ddd-b2ef-f973b82b0b7d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:12.078947 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3687a687-3726-4709-ab0b-0af78e6491e3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:12.079640 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-3687a687-3726-4709-ab0b-0af78e6491e3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:12.087894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3687a687-3726-4709-ab0b-0af78e6491e3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:12.089274 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3687a687-3726-4709-ab0b-0af78e6491e3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:12.090396 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3687a687-3726-4709-ab0b-0af78e6491e3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:12.090972 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3687a687-3726-4709-ab0b-0af78e6491e3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:12.290776 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-3687a687-3726-4709-ab0b-0af78e6491e3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:12.305220 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3687a687-3726-4709-ab0b-0af78e6491e3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.227616 Jul 04 04:15:12.306145 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 58/103] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:12 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:12.391750 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5e716f2b-0267-4ddd-b2ef-f973b82b0b7d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:12.407504 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5e716f2b-0267-4ddd-b2ef-f973b82b0b7d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.449053 Jul 04 04:15:12.420199 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 46/104] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:11 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:12.808251 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c880d298-0ed4-4864-bbdc-630664986e8c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:12.808993 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c880d298-0ed4-4864-bbdc-630664986e8c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:12.817939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c880d298-0ed4-4864-bbdc-630664986e8c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:12.819343 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c880d298-0ed4-4864-bbdc-630664986e8c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:12.820203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c880d298-0ed4-4864-bbdc-630664986e8c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:12.820769 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c880d298-0ed4-4864-bbdc-630664986e8c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:12.936052 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-0f0c96f7-11bd-4738-b29c-cfbd4c0fe5f3 req-976a0aa4-a401-4da6-88b4-ca55b7b697e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e519dd6-a044-4afa-ac1b-bf1f53611738", "tag": "3384abec-b08a-4477-8514-51d16c8ee80f"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:15:12.950758 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-0f0c96f7-11bd-4738-b29c-cfbd4c0fe5f3 req-976a0aa4-a401-4da6-88b4-ca55b7b697e4 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:12.951346 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-0f0c96f7-11bd-4738-b29c-cfbd4c0fe5f3 req-976a0aa4-a401-4da6-88b4-ca55b7b697e4 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:12.984566 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-0f0c96f7-11bd-4738-b29c-cfbd4c0fe5f3 req-976a0aa4-a401-4da6-88b4-ca55b7b697e4 service nova] Creating event network-changed:3384abec-b08a-4477-8514-51d16c8ee80f for instance 6e519dd6-a044-4afa-ac1b-bf1f53611738 on hv-cinder-74216 Jul 04 04:15:12.985180 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-0f0c96f7-11bd-4738-b29c-cfbd4c0fe5f3 req-976a0aa4-a401-4da6-88b4-ca55b7b697e4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117877) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 04 04:15:12.986583 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-256c34b4-2ebc-49d1-acc4-87ed97b044dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:12.987191 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-256c34b4-2ebc-49d1-acc4-87ed97b044dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:12.988127 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-256c34b4-2ebc-49d1-acc4-87ed97b044dc None None] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:12.988665 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-256c34b4-2ebc-49d1-acc4-87ed97b044dc None None] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:12.999242 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.compute.rpcapi [None req-256c34b4-2ebc-49d1-acc4-87ed97b044dc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 04 04:15:13.000255 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-256c34b4-2ebc-49d1-acc4-87ed97b044dc None None] Releasing lock "compute-rpcapi-router" {{(pid=117877) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 04 04:15:13.045958 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-256c34b4-2ebc-49d1-acc4-87ed97b044dc None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220163 Jul 04 04:15:13.052062 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 47/105] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:15:13.053525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c880d298-0ed4-4864-bbdc-630664986e8c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:13.068906 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c880d298-0ed4-4864-bbdc-630664986e8c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.267273 Jul 04 04:15:13.070413 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 59/106] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:12 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:13.326517 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c34ff1de-bb9f-450b-9b82-01b7f26d72e1 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:13.327376 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c34ff1de-bb9f-450b-9b82-01b7f26d72e1 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:13.336133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c34ff1de-bb9f-450b-9b82-01b7f26d72e1 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:13.336686 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c34ff1de-bb9f-450b-9b82-01b7f26d72e1 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:13.337630 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c34ff1de-bb9f-450b-9b82-01b7f26d72e1 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:13.338219 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c34ff1de-bb9f-450b-9b82-01b7f26d72e1 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:13.427639 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-dcc29114-f09a-4988-a3d6-145b75e78557 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:13.428183 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-dcc29114-f09a-4988-a3d6-145b75e78557 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:13.434703 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dcc29114-f09a-4988-a3d6-145b75e78557 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:13.435342 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dcc29114-f09a-4988-a3d6-145b75e78557 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:13.436113 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dcc29114-f09a-4988-a3d6-145b75e78557 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:13.436538 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dcc29114-f09a-4988-a3d6-145b75e78557 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:13.474515 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c34ff1de-bb9f-450b-9b82-01b7f26d72e1 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:13.482328 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c34ff1de-bb9f-450b-9b82-01b7f26d72e1 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.161840 Jul 04 04:15:13.482946 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 48/107] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:13 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:13.573512 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-dcc29114-f09a-4988-a3d6-145b75e78557 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:13.584306 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-dcc29114-f09a-4988-a3d6-145b75e78557 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.160528 Jul 04 04:15:13.585071 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 60/108] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:13 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:14.089643 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0bee56d1-4742-42cc-bad4-976e761c7ecd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:14.090259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0bee56d1-4742-42cc-bad4-976e761c7ecd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:14.097171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0bee56d1-4742-42cc-bad4-976e761c7ecd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:14.097620 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0bee56d1-4742-42cc-bad4-976e761c7ecd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:14.098390 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0bee56d1-4742-42cc-bad4-976e761c7ecd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:14.098842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0bee56d1-4742-42cc-bad4-976e761c7ecd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:14.233148 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0bee56d1-4742-42cc-bad4-976e761c7ecd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:14.244867 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0bee56d1-4742-42cc-bad4-976e761c7ecd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.161375 Jul 04 04:15:14.245497 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 49/109] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:14 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:14.499378 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ef591280-72d6-476c-844f-00635c2bc1ec tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:14.499969 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-ef591280-72d6-476c-844f-00635c2bc1ec tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:14.506537 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ef591280-72d6-476c-844f-00635c2bc1ec tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:14.506983 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ef591280-72d6-476c-844f-00635c2bc1ec tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:14.507737 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ef591280-72d6-476c-844f-00635c2bc1ec tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:14.508162 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ef591280-72d6-476c-844f-00635c2bc1ec tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:14.601711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-55d1c7ae-4099-4c6c-b2c1-d4e387a71846 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:14.602495 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-55d1c7ae-4099-4c6c-b2c1-d4e387a71846 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:14.609336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55d1c7ae-4099-4c6c-b2c1-d4e387a71846 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:14.609854 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55d1c7ae-4099-4c6c-b2c1-d4e387a71846 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:14.610725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55d1c7ae-4099-4c6c-b2c1-d4e387a71846 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:14.611225 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55d1c7ae-4099-4c6c-b2c1-d4e387a71846 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:14.655305 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-ef591280-72d6-476c-844f-00635c2bc1ec tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:14.663395 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ef591280-72d6-476c-844f-00635c2bc1ec tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.167910 Jul 04 04:15:14.663966 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 61/110] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:14 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:14.747999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-55d1c7ae-4099-4c6c-b2c1-d4e387a71846 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:14.755456 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-55d1c7ae-4099-4c6c-b2c1-d4e387a71846 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.157756 Jul 04 04:15:14.756013 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 50/111] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:14 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:15.072949 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-732c4a8a-c6a2-4264-9357-84ffc22ee748 req-e62adae0-e51b-4c02-b67e-b159047b8275 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dbd2b17-e16f-4867-87bd-9e0430d8b027", "tag": "44387a5e-08a3-462a-be05-f2befd8e7016"}, {"name": "network-changed", "server_uuid": "be90f3f9-d0dd-4296-ba6b-dc719d491a12", "tag": "9e8db02a-f437-48df-a498-4ab55ec549fb"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:15:15.088259 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-732c4a8a-c6a2-4264-9357-84ffc22ee748 req-e62adae0-e51b-4c02-b67e-b159047b8275 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:15.089129 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-732c4a8a-c6a2-4264-9357-84ffc22ee748 req-e62adae0-e51b-4c02-b67e-b159047b8275 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:15.103372 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-732c4a8a-c6a2-4264-9357-84ffc22ee748 req-e62adae0-e51b-4c02-b67e-b159047b8275 service nova] Creating event network-changed:44387a5e-08a3-462a-be05-f2befd8e7016 for instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 on hv-cinder-74216 Jul 04 04:15:15.103874 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-732c4a8a-c6a2-4264-9357-84ffc22ee748 req-e62adae0-e51b-4c02-b67e-b159047b8275 service nova] Creating event network-changed:9e8db02a-f437-48df-a498-4ab55ec549fb for instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 on hv-cinder-74216 Jul 04 04:15:15.110665 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-732c4a8a-c6a2-4264-9357-84ffc22ee748 req-e62adae0-e51b-4c02-b67e-b159047b8275 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.043894 Jul 04 04:15:15.111246 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 62/112] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:15:15.261789 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-86dd3722-6836-4dd4-b594-d8b26250f4cd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:15.262394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-86dd3722-6836-4dd4-b594-d8b26250f4cd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:15.269137 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86dd3722-6836-4dd4-b594-d8b26250f4cd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:15.269577 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86dd3722-6836-4dd4-b594-d8b26250f4cd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:15.270325 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86dd3722-6836-4dd4-b594-d8b26250f4cd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:15.270782 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86dd3722-6836-4dd4-b594-d8b26250f4cd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:15.288684 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:15.413894 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-86dd3722-6836-4dd4-b594-d8b26250f4cd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:15.422162 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-86dd3722-6836-4dd4-b594-d8b26250f4cd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.164235 Jul 04 04:15:15.422799 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 51/113] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:15 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:15.681377 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e9239749-82e1-4747-984e-a8920ca2d859 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:15.682071 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e9239749-82e1-4747-984e-a8920ca2d859 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:15.689139 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e9239749-82e1-4747-984e-a8920ca2d859 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:15.690250 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e9239749-82e1-4747-984e-a8920ca2d859 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:15.691085 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e9239749-82e1-4747-984e-a8920ca2d859 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:15.691513 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e9239749-82e1-4747-984e-a8920ca2d859 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:15.772444 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6ac47a0a-1302-4ea1-ba24-30d14856ad1a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:15.772973 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6ac47a0a-1302-4ea1-ba24-30d14856ad1a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:15.788918 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ac47a0a-1302-4ea1-ba24-30d14856ad1a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:15.789558 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ac47a0a-1302-4ea1-ba24-30d14856ad1a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:15.790506 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ac47a0a-1302-4ea1-ba24-30d14856ad1a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:15.791144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ac47a0a-1302-4ea1-ba24-30d14856ad1a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:16.100891 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e9239749-82e1-4747-984e-a8920ca2d859 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:16.104750 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=100 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:16.110236 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e9239749-82e1-4747-984e-a8920ca2d859 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.432757 Jul 04 04:15:16.120604 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 63/114] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:15 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:16.429308 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6ac47a0a-1302-4ea1-ba24-30d14856ad1a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:16.437388 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6ac47a0a-1302-4ea1-ba24-30d14856ad1a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.668968 Jul 04 04:15:16.437971 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 52/115] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:15 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:16.445229 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-cbbd6752-6a95-4c65-b036-0e4bd8e6950b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:16.446078 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-cbbd6752-6a95-4c65-b036-0e4bd8e6950b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:16.453007 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cbbd6752-6a95-4c65-b036-0e4bd8e6950b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:16.453601 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cbbd6752-6a95-4c65-b036-0e4bd8e6950b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:16.454385 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cbbd6752-6a95-4c65-b036-0e4bd8e6950b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:16.454838 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cbbd6752-6a95-4c65-b036-0e4bd8e6950b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:16.590494 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-cbbd6752-6a95-4c65-b036-0e4bd8e6950b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:16.597969 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-cbbd6752-6a95-4c65-b036-0e4bd8e6950b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.156990 Jul 04 04:15:16.598613 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 64/116] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:16 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:16.931203 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ad5aefcf-d018-4241-bd6a-1dfd45dbe993 tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] Calling method '.version_select at 0x7f50c1cf3820>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:16.983587 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ad5aefcf-d018-4241-bd6a-1dfd45dbe993 tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/89858718-6048-4383-8f90-b53be783b02a" status: 200 len: 350 microversion: 2.1 time: 0.056889 Jul 04 04:15:16.984172 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 53/117] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jul 4 04:15:16 2022] GET /compute/v2.1/os-volumes/89858718-6048-4383-8f90-b53be783b02a => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:15:17.128619 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-23cf2236-7916-40f7-b315-6c1a7142bfdc tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:17.129483 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-23cf2236-7916-40f7-b315-6c1a7142bfdc tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:17.136996 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-23cf2236-7916-40f7-b315-6c1a7142bfdc tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:17.137366 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-23cf2236-7916-40f7-b315-6c1a7142bfdc tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:17.138152 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-23cf2236-7916-40f7-b315-6c1a7142bfdc tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:17.138625 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-23cf2236-7916-40f7-b315-6c1a7142bfdc tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:17.310286 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-23cf2236-7916-40f7-b315-6c1a7142bfdc tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:17.322302 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-23cf2236-7916-40f7-b315-6c1a7142bfdc tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.197904 Jul 04 04:15:17.323785 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 65/118] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:17 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:17.455437 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dc922c20-22b0-4900-b53a-e75bddc380d7 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:17.456319 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dc922c20-22b0-4900-b53a-e75bddc380d7 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:17.462937 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc922c20-22b0-4900-b53a-e75bddc380d7 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:17.463890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc922c20-22b0-4900-b53a-e75bddc380d7 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:17.465499 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc922c20-22b0-4900-b53a-e75bddc380d7 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:17.466261 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc922c20-22b0-4900-b53a-e75bddc380d7 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:17.615400 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-8d81b227-e0d9-47d1-98aa-75787edd7499 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:17.616476 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-8d81b227-e0d9-47d1-98aa-75787edd7499 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:17.621794 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dc922c20-22b0-4900-b53a-e75bddc380d7 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:17.623416 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8d81b227-e0d9-47d1-98aa-75787edd7499 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:17.623894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8d81b227-e0d9-47d1-98aa-75787edd7499 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:17.624664 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8d81b227-e0d9-47d1-98aa-75787edd7499 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:17.625291 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8d81b227-e0d9-47d1-98aa-75787edd7499 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:17.634012 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dc922c20-22b0-4900-b53a-e75bddc380d7 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.182180 Jul 04 04:15:17.646147 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 54/119] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:17 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:17.775212 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-8d81b227-e0d9-47d1-98aa-75787edd7499 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:17.784618 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-8d81b227-e0d9-47d1-98aa-75787edd7499 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.172915 Jul 04 04:15:17.785266 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 66/120] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:17 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:18.344255 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-39cac3bd-24b2-41e3-9977-58d7f2df92b1 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:18.345436 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-39cac3bd-24b2-41e3-9977-58d7f2df92b1 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:18.356211 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39cac3bd-24b2-41e3-9977-58d7f2df92b1 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:18.356847 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39cac3bd-24b2-41e3-9977-58d7f2df92b1 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:18.357583 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39cac3bd-24b2-41e3-9977-58d7f2df92b1 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:18.358031 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39cac3bd-24b2-41e3-9977-58d7f2df92b1 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:18.491685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-39cac3bd-24b2-41e3-9977-58d7f2df92b1 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:18.499470 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-39cac3bd-24b2-41e3-9977-58d7f2df92b1 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.161731 Jul 04 04:15:18.500020 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 55/121] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:18 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:18.655221 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ff386e39-02e8-4fd5-97d7-59f7bc9acb33 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:18.655834 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-ff386e39-02e8-4fd5-97d7-59f7bc9acb33 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:18.662774 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ff386e39-02e8-4fd5-97d7-59f7bc9acb33 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:18.663380 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ff386e39-02e8-4fd5-97d7-59f7bc9acb33 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:18.664139 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ff386e39-02e8-4fd5-97d7-59f7bc9acb33 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:18.664572 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ff386e39-02e8-4fd5-97d7-59f7bc9acb33 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:18.797441 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-ff386e39-02e8-4fd5-97d7-59f7bc9acb33 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:18.802422 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-12170c53-a2bd-4262-b24e-5b3ca1b183ad tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:18.803009 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-12170c53-a2bd-4262-b24e-5b3ca1b183ad tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:18.805309 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ff386e39-02e8-4fd5-97d7-59f7bc9acb33 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.154748 Jul 04 04:15:18.806195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 67/122] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:18 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:18.811290 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12170c53-a2bd-4262-b24e-5b3ca1b183ad tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:18.811820 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12170c53-a2bd-4262-b24e-5b3ca1b183ad tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:18.812669 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12170c53-a2bd-4262-b24e-5b3ca1b183ad tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:18.813217 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-12170c53-a2bd-4262-b24e-5b3ca1b183ad tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:18.944117 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-12170c53-a2bd-4262-b24e-5b3ca1b183ad tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:18.952374 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-12170c53-a2bd-4262-b24e-5b3ca1b183ad tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.153759 Jul 04 04:15:18.952971 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 56/123] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:18 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:19.521363 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-cf6fb3ab-728c-4677-b9af-38ea4447efab tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:19.522455 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-cf6fb3ab-728c-4677-b9af-38ea4447efab tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:19.530968 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cf6fb3ab-728c-4677-b9af-38ea4447efab tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:19.531403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cf6fb3ab-728c-4677-b9af-38ea4447efab tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:19.532154 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cf6fb3ab-728c-4677-b9af-38ea4447efab tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:19.532581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cf6fb3ab-728c-4677-b9af-38ea4447efab tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:19.683499 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-cf6fb3ab-728c-4677-b9af-38ea4447efab tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:19.692915 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-cf6fb3ab-728c-4677-b9af-38ea4447efab tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.178648 Jul 04 04:15:19.693751 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 68/124] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:19 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:19.825859 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-428cdffe-719e-4417-83d3-f74bcb690d56 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:19.826431 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-428cdffe-719e-4417-83d3-f74bcb690d56 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:19.832734 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-428cdffe-719e-4417-83d3-f74bcb690d56 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:19.833175 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-428cdffe-719e-4417-83d3-f74bcb690d56 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:19.833912 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-428cdffe-719e-4417-83d3-f74bcb690d56 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:19.834334 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-428cdffe-719e-4417-83d3-f74bcb690d56 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:19.970129 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-997eee32-1d67-4a15-8217-181c9e04821f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:19.970902 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-997eee32-1d67-4a15-8217-181c9e04821f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:19.971489 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-428cdffe-719e-4417-83d3-f74bcb690d56 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:19.977207 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-997eee32-1d67-4a15-8217-181c9e04821f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:19.977644 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-997eee32-1d67-4a15-8217-181c9e04821f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:19.978403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-997eee32-1d67-4a15-8217-181c9e04821f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:19.978823 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-997eee32-1d67-4a15-8217-181c9e04821f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:19.979291 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-428cdffe-719e-4417-83d3-f74bcb690d56 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.159334 Jul 04 04:15:19.979937 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 57/125] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:19 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:20.118781 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-997eee32-1d67-4a15-8217-181c9e04821f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:20.128014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-997eee32-1d67-4a15-8217-181c9e04821f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.162264 Jul 04 04:15:20.128576 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 69/126] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:19 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:20.712421 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a2522098-37b2-432c-b56a-cecc8d01d5e4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:20.713095 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a2522098-37b2-432c-b56a-cecc8d01d5e4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:20.719908 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2522098-37b2-432c-b56a-cecc8d01d5e4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:20.720530 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2522098-37b2-432c-b56a-cecc8d01d5e4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:20.721179 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2522098-37b2-432c-b56a-cecc8d01d5e4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:20.721638 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2522098-37b2-432c-b56a-cecc8d01d5e4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:20.855632 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a2522098-37b2-432c-b56a-cecc8d01d5e4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:20.863296 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a2522098-37b2-432c-b56a-cecc8d01d5e4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.154786 Jul 04 04:15:20.863829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 58/127] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:20 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:20.996464 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e5cfa4a3-103f-4395-bc03-3f032b5c4035 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:20.997163 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e5cfa4a3-103f-4395-bc03-3f032b5c4035 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:21.004386 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e5cfa4a3-103f-4395-bc03-3f032b5c4035 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:21.004831 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e5cfa4a3-103f-4395-bc03-3f032b5c4035 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:21.005599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e5cfa4a3-103f-4395-bc03-3f032b5c4035 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:21.006074 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e5cfa4a3-103f-4395-bc03-3f032b5c4035 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:21.145843 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9f6fc750-6a24-4151-b1cf-f8e3ace7ea69 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:21.146512 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9f6fc750-6a24-4151-b1cf-f8e3ace7ea69 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:21.146713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e5cfa4a3-103f-4395-bc03-3f032b5c4035 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:21.152630 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f6fc750-6a24-4151-b1cf-f8e3ace7ea69 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:21.153073 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f6fc750-6a24-4151-b1cf-f8e3ace7ea69 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:21.153827 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f6fc750-6a24-4151-b1cf-f8e3ace7ea69 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:21.154177 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e5cfa4a3-103f-4395-bc03-3f032b5c4035 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.161710 Jul 04 04:15:21.154293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f6fc750-6a24-4151-b1cf-f8e3ace7ea69 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:21.154787 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 70/128] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:20 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:21.296146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9f6fc750-6a24-4151-b1cf-f8e3ace7ea69 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:21.303607 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9f6fc750-6a24-4151-b1cf-f8e3ace7ea69 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.161671 Jul 04 04:15:21.304177 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 59/129] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:21 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:21.883219 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-24e00c8b-16d2-4ba0-ab70-da5c1dc61b31 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:21.884076 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-24e00c8b-16d2-4ba0-ab70-da5c1dc61b31 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:21.886812 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=2 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:21.892922 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-24e00c8b-16d2-4ba0-ab70-da5c1dc61b31 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:21.893357 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-24e00c8b-16d2-4ba0-ab70-da5c1dc61b31 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:21.894117 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-24e00c8b-16d2-4ba0-ab70-da5c1dc61b31 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:21.894580 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-24e00c8b-16d2-4ba0-ab70-da5c1dc61b31 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:22.032414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-24e00c8b-16d2-4ba0-ab70-da5c1dc61b31 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:22.040274 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-24e00c8b-16d2-4ba0-ab70-da5c1dc61b31 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.163023 Jul 04 04:15:22.040863 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 71/130] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:21 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:22.173668 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8a8b039d-562b-4c68-aae3-7a1ad34665f2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:22.174404 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8a8b039d-562b-4c68-aae3-7a1ad34665f2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:22.182125 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a8b039d-562b-4c68-aae3-7a1ad34665f2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:22.182698 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a8b039d-562b-4c68-aae3-7a1ad34665f2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:22.183590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a8b039d-562b-4c68-aae3-7a1ad34665f2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:22.184094 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8a8b039d-562b-4c68-aae3-7a1ad34665f2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:22.320675 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f97645bc-59be-4938-a2ca-d64c8296f9b3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:22.321353 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f97645bc-59be-4938-a2ca-d64c8296f9b3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:22.327405 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8a8b039d-562b-4c68-aae3-7a1ad34665f2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:22.327770 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f97645bc-59be-4938-a2ca-d64c8296f9b3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:22.328213 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f97645bc-59be-4938-a2ca-d64c8296f9b3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:22.329002 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f97645bc-59be-4938-a2ca-d64c8296f9b3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:22.329403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f97645bc-59be-4938-a2ca-d64c8296f9b3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:22.335442 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8a8b039d-562b-4c68-aae3-7a1ad34665f2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.167420 Jul 04 04:15:22.336062 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 60/131] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:22 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:22.480261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f97645bc-59be-4938-a2ca-d64c8296f9b3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:22.488351 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-f97645bc-59be-4938-a2ca-d64c8296f9b3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.171709 Jul 04 04:15:22.488899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 72/132] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:22 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:23.057991 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4fcb0b1c-bf68-4bf6-a3ee-5206d25e8039 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:23.058728 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4fcb0b1c-bf68-4bf6-a3ee-5206d25e8039 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:23.062006 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:23.068784 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4fcb0b1c-bf68-4bf6-a3ee-5206d25e8039 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:23.069239 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4fcb0b1c-bf68-4bf6-a3ee-5206d25e8039 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:23.070041 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4fcb0b1c-bf68-4bf6-a3ee-5206d25e8039 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:23.070521 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4fcb0b1c-bf68-4bf6-a3ee-5206d25e8039 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:23.208083 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4fcb0b1c-bf68-4bf6-a3ee-5206d25e8039 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:23.215690 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4fcb0b1c-bf68-4bf6-a3ee-5206d25e8039 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.162349 Jul 04 04:15:23.216263 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 61/133] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:23 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:23.353865 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-386a414a-246b-467c-b8bb-2c583a897b9d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:23.354423 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-386a414a-246b-467c-b8bb-2c583a897b9d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:23.360552 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-386a414a-246b-467c-b8bb-2c583a897b9d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:23.361001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-386a414a-246b-467c-b8bb-2c583a897b9d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:23.361784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-386a414a-246b-467c-b8bb-2c583a897b9d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:23.362221 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-386a414a-246b-467c-b8bb-2c583a897b9d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:23.504855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-386a414a-246b-467c-b8bb-2c583a897b9d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:23.505070 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-44a88bde-19c6-4e11-a070-f62432ffa6e4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:23.505677 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-44a88bde-19c6-4e11-a070-f62432ffa6e4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:23.511686 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44a88bde-19c6-4e11-a070-f62432ffa6e4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:23.512137 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44a88bde-19c6-4e11-a070-f62432ffa6e4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:23.512886 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44a88bde-19c6-4e11-a070-f62432ffa6e4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:23.512979 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-386a414a-246b-467c-b8bb-2c583a897b9d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.163314 Jul 04 04:15:23.513313 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44a88bde-19c6-4e11-a070-f62432ffa6e4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:23.513617 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 73/134] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:23 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:23.805426 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-44a88bde-19c6-4e11-a070-f62432ffa6e4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:23.821757 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-44a88bde-19c6-4e11-a070-f62432ffa6e4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.318863 Jul 04 04:15:23.823039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 62/135] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:23 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:24.233954 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-47fd685f-fe3b-4adf-90b7-322e0876a49f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:24.234574 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-47fd685f-fe3b-4adf-90b7-322e0876a49f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:24.245012 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-47fd685f-fe3b-4adf-90b7-322e0876a49f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:24.245838 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-47fd685f-fe3b-4adf-90b7-322e0876a49f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:24.246673 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-47fd685f-fe3b-4adf-90b7-322e0876a49f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:24.247193 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-47fd685f-fe3b-4adf-90b7-322e0876a49f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:24.414206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-47fd685f-fe3b-4adf-90b7-322e0876a49f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:24.423349 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-47fd685f-fe3b-4adf-90b7-322e0876a49f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.193727 Jul 04 04:15:24.424275 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 74/136] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:24 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:24.532046 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-68ee8570-a0b1-4d05-9db4-1da3801a4c0a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:24.533091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-68ee8570-a0b1-4d05-9db4-1da3801a4c0a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:24.539778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68ee8570-a0b1-4d05-9db4-1da3801a4c0a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:24.540324 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68ee8570-a0b1-4d05-9db4-1da3801a4c0a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:24.541112 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68ee8570-a0b1-4d05-9db4-1da3801a4c0a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:24.541545 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68ee8570-a0b1-4d05-9db4-1da3801a4c0a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:24.681440 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-68ee8570-a0b1-4d05-9db4-1da3801a4c0a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:24.689941 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-68ee8570-a0b1-4d05-9db4-1da3801a4c0a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.163081 Jul 04 04:15:24.690336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 63/137] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:24 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:24.722819 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3f893904-4502-44e1-ad3c-c6cb3257a231 tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] Calling method '.version_select at 0x7f50c1450ca0>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:24.774143 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3f893904-4502-44e1-ad3c-c6cb3257a231 tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9d631bc2-d3eb-4fff-94e4-d525bdaa37c0" status: 200 len: 350 microversion: 2.1 time: 0.055408 Jul 04 04:15:24.774773 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 75/138] 10.222.0.16 () {58 vars in 1244 bytes} [Mon Jul 4 04:15:24 2022] GET /compute/v2.1/os-volumes/9d631bc2-d3eb-4fff-94e4-d525bdaa37c0 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:15:24.786615 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c2ab0ff8-7584-4457-9a9c-c047a8151af1 tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] Calling method '.version_select at 0x7f50c1ce0820>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:24.839415 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b4737ef9-d07a-4f72-9add-c7c1c4da691c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:24.840035 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b4737ef9-d07a-4f72-9add-c7c1c4da691c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:24.846426 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b4737ef9-d07a-4f72-9add-c7c1c4da691c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:24.846865 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b4737ef9-d07a-4f72-9add-c7c1c4da691c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:24.847615 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b4737ef9-d07a-4f72-9add-c7c1c4da691c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:24.848041 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b4737ef9-d07a-4f72-9add-c7c1c4da691c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:24.869080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c2ab0ff8-7584-4457-9a9c-c047a8151af1 tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086342 Jul 04 04:15:24.869684 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 64/139] 10.222.0.16 () {58 vars in 1133 bytes} [Mon Jul 4 04:15:24 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:24.882044 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ada1dbc2-6dfb-439f-bb5a-32fd19d79a4f tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] Calling method '.version_select at 0x7f50c1ceb940>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:24.966639 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ada1dbc2-6dfb-439f-bb5a-32fd19d79a4f tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.088145 Jul 04 04:15:24.967270 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 65/140] 10.222.0.16 () {58 vars in 1148 bytes} [Mon Jul 4 04:15:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:15:24.980431 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ca1d8a24-255c-4c80-ae0f-b5bbc5c1f8be tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] Calling method '.version_select at 0x7f50c1cf33a0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:25.002672 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b4737ef9-d07a-4f72-9add-c7c1c4da691c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:25.011414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b4737ef9-d07a-4f72-9add-c7c1c4da691c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.175894 Jul 04 04:15:25.011994 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 76/141] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:24 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:25.128545 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ca1d8a24-255c-4c80-ae0f-b5bbc5c1f8be tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.151558 Jul 04 04:15:25.129361 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 66/142] 10.222.0.16 () {58 vars in 1133 bytes} [Mon Jul 4 04:15:24 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:25.144213 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-4e2b3824-7044-4d31-931b-c80bb2306688 tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] Calling method '.version_select at 0x7f50c1496f70>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:25.243541 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-4e2b3824-7044-4d31-931b-c80bb2306688 tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.106702 Jul 04 04:15:25.244623 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 77/143] 10.222.0.16 () {58 vars in 1166 bytes} [Mon Jul 4 04:15:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:15:25.258307 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-16f7f7b1-7bef-44bc-8c6e-ebc3d7130481 tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] Calling method '.version_select at 0x7f50c1cf3a60>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:25.374734 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-16f7f7b1-7bef-44bc-8c6e-ebc3d7130481 tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.120320 Jul 04 04:15:25.375784 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 67/144] 10.222.0.16 () {58 vars in 1169 bytes} [Mon Jul 4 04:15:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:15:25.388416 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e70d3a0d-642b-4b78-b82f-548465a62d42 tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] Calling method '.version_select at 0x7f50c13f7b80>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:25.441796 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-63ff2b7f-d00e-4689-b239-abb1d502274a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:25.442481 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-63ff2b7f-d00e-4689-b239-abb1d502274a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:25.455528 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63ff2b7f-d00e-4689-b239-abb1d502274a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:25.456175 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63ff2b7f-d00e-4689-b239-abb1d502274a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:25.458056 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63ff2b7f-d00e-4689-b239-abb1d502274a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:25.459961 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63ff2b7f-d00e-4689-b239-abb1d502274a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:25.548243 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e70d3a0d-642b-4b78-b82f-548465a62d42 tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.164628 Jul 04 04:15:25.548814 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 78/145] 10.222.0.16 () {58 vars in 1154 bytes} [Mon Jul 4 04:15:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:25.565691 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3407c9c6-8b61-4572-9a25-e4d17252cfba tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] Calling method '.version_select at 0x7f50c14170d0>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:25.645681 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-63ff2b7f-d00e-4689-b239-abb1d502274a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:25.655775 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-63ff2b7f-d00e-4689-b239-abb1d502274a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.219103 Jul 04 04:15:25.665065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 68/146] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:25 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:25.688610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3407c9c6-8b61-4572-9a25-e4d17252cfba tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.127328 Jul 04 04:15:25.695702 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 79/147] 10.222.0.16 () {58 vars in 1187 bytes} [Mon Jul 4 04:15:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:15:25.702349 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c72b8714-1d01-4c2d-9d78-4f6e87663c9a tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] Calling method '.version_select at 0x7f50c13f7ee0>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:25.749738 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-7549c91f-dbfb-493e-989a-cbaa1da7b7d1 req-d67a768f-7fe9-49b4-a57d-c9285ff41b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "314d0a92-11cc-45ac-b70b-1c65f66ecfc4", "name": "network-vif-plugged", "status": "completed", "tag": "0de8d78e-8696-4840-bc1b-e94f52bb4eb1"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:15:25.759956 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-7549c91f-dbfb-493e-989a-cbaa1da7b7d1 req-d67a768f-7fe9-49b4-a57d-c9285ff41b56 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:25.760693 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-7549c91f-dbfb-493e-989a-cbaa1da7b7d1 req-d67a768f-7fe9-49b4-a57d-c9285ff41b56 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:25.786714 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-7549c91f-dbfb-493e-989a-cbaa1da7b7d1 req-d67a768f-7fe9-49b4-a57d-c9285ff41b56 service nova] Creating event network-vif-plugged:0de8d78e-8696-4840-bc1b-e94f52bb4eb1 for instance 314d0a92-11cc-45ac-b70b-1c65f66ecfc4 on hv-cinder-74216 Jul 04 04:15:25.794657 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-7549c91f-dbfb-493e-989a-cbaa1da7b7d1 req-d67a768f-7fe9-49b4-a57d-c9285ff41b56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131326 Jul 04 04:15:25.795500 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 69/148] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:15:25.803690 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5cf11fff-9706-41ad-85bb-3a267b913fb5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:25.804931 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5cf11fff-9706-41ad-85bb-3a267b913fb5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:25.809355 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c72b8714-1d01-4c2d-9d78-4f6e87663c9a tempest-VolumesTestJSON-508895463 tempest-VolumesTestJSON-508895463-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.111227 Jul 04 04:15:25.810558 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 80/149] 10.222.0.16 () {58 vars in 1154 bytes} [Mon Jul 4 04:15:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:25.813816 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5cf11fff-9706-41ad-85bb-3a267b913fb5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:25.814690 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5cf11fff-9706-41ad-85bb-3a267b913fb5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:25.816783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5cf11fff-9706-41ad-85bb-3a267b913fb5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:25.817640 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5cf11fff-9706-41ad-85bb-3a267b913fb5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:25.986660 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5cf11fff-9706-41ad-85bb-3a267b913fb5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:25.990741 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5cf11fff-9706-41ad-85bb-3a267b913fb5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.193499 Jul 04 04:15:25.999969 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 70/150] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:25 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:26.029325 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-cf219740-3709-4de7-81df-467377b38286 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:26.030010 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-cf219740-3709-4de7-81df-467377b38286 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:26.036627 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cf219740-3709-4de7-81df-467377b38286 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:26.037081 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cf219740-3709-4de7-81df-467377b38286 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:26.039796 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cf219740-3709-4de7-81df-467377b38286 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:26.040410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cf219740-3709-4de7-81df-467377b38286 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:26.190169 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-cf219740-3709-4de7-81df-467377b38286 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:26.198652 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-cf219740-3709-4de7-81df-467377b38286 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.173633 Jul 04 04:15:26.199544 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 81/151] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:26 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:26.673135 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9a6cc9ef-8877-45b4-bed9-d6bd2af99908 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:26.673679 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9a6cc9ef-8877-45b4-bed9-d6bd2af99908 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:26.679938 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a6cc9ef-8877-45b4-bed9-d6bd2af99908 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:26.680385 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a6cc9ef-8877-45b4-bed9-d6bd2af99908 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:26.681157 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a6cc9ef-8877-45b4-bed9-d6bd2af99908 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:26.682025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a6cc9ef-8877-45b4-bed9-d6bd2af99908 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:26.824027 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9a6cc9ef-8877-45b4-bed9-d6bd2af99908 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:26.832311 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9a6cc9ef-8877-45b4-bed9-d6bd2af99908 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.163207 Jul 04 04:15:26.833304 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 71/152] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:26 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:27.007498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-15b72d55-3a0c-4903-86fc-5b1dccd29182 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:27.008232 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-15b72d55-3a0c-4903-86fc-5b1dccd29182 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:27.015358 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-15b72d55-3a0c-4903-86fc-5b1dccd29182 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:27.015786 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-15b72d55-3a0c-4903-86fc-5b1dccd29182 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:27.016703 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-15b72d55-3a0c-4903-86fc-5b1dccd29182 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:27.017187 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-15b72d55-3a0c-4903-86fc-5b1dccd29182 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:27.154299 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-15b72d55-3a0c-4903-86fc-5b1dccd29182 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:27.162667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-15b72d55-3a0c-4903-86fc-5b1dccd29182 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.158921 Jul 04 04:15:27.163262 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 82/153] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:27 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:27.214968 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3567658b-b1cc-4e79-9cd5-c3af296f8955 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:27.215568 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3567658b-b1cc-4e79-9cd5-c3af296f8955 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:27.221767 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3567658b-b1cc-4e79-9cd5-c3af296f8955 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:27.222215 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3567658b-b1cc-4e79-9cd5-c3af296f8955 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:27.223011 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3567658b-b1cc-4e79-9cd5-c3af296f8955 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:27.223445 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3567658b-b1cc-4e79-9cd5-c3af296f8955 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:27.364045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3567658b-b1cc-4e79-9cd5-c3af296f8955 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:27.371850 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3567658b-b1cc-4e79-9cd5-c3af296f8955 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.160655 Jul 04 04:15:27.372466 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 72/154] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:27 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:27.849305 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-792f30ef-0110-450b-87c2-a1308f25dfda tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:27.849915 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-792f30ef-0110-450b-87c2-a1308f25dfda tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:27.856445 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-792f30ef-0110-450b-87c2-a1308f25dfda tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:27.856888 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-792f30ef-0110-450b-87c2-a1308f25dfda tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:27.857654 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-792f30ef-0110-450b-87c2-a1308f25dfda tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:27.858075 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-792f30ef-0110-450b-87c2-a1308f25dfda tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:27.997794 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-792f30ef-0110-450b-87c2-a1308f25dfda tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:28.006357 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-792f30ef-0110-450b-87c2-a1308f25dfda tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.161015 Jul 04 04:15:28.006973 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 83/155] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:27 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:28.180193 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4979c918-4792-48dd-83ac-37c549db50bd tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:28.180849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4979c918-4792-48dd-83ac-37c549db50bd tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:28.187794 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4979c918-4792-48dd-83ac-37c549db50bd tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:28.188255 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4979c918-4792-48dd-83ac-37c549db50bd tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:28.189000 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4979c918-4792-48dd-83ac-37c549db50bd tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:28.189427 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4979c918-4792-48dd-83ac-37c549db50bd tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:28.327992 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4979c918-4792-48dd-83ac-37c549db50bd tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:28.331651 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:28.337216 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4979c918-4792-48dd-83ac-37c549db50bd tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.161410 Jul 04 04:15:28.337789 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 73/156] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:28 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:28.388663 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-519be975-3d98-4a2a-b409-6e224f079e94 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:28.389719 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-519be975-3d98-4a2a-b409-6e224f079e94 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:28.396585 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-519be975-3d98-4a2a-b409-6e224f079e94 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:28.397027 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-519be975-3d98-4a2a-b409-6e224f079e94 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:28.397783 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-519be975-3d98-4a2a-b409-6e224f079e94 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:28.398195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-519be975-3d98-4a2a-b409-6e224f079e94 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:28.542670 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-519be975-3d98-4a2a-b409-6e224f079e94 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:28.551538 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-519be975-3d98-4a2a-b409-6e224f079e94 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.166758 Jul 04 04:15:28.552177 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 84/157] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:28 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:29.024989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-09de9faf-bbaa-4d77-bcd7-086ce1938162 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:29.025605 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-09de9faf-bbaa-4d77-bcd7-086ce1938162 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:29.031942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-09de9faf-bbaa-4d77-bcd7-086ce1938162 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:29.032428 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-09de9faf-bbaa-4d77-bcd7-086ce1938162 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:29.033228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-09de9faf-bbaa-4d77-bcd7-086ce1938162 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:29.033679 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-09de9faf-bbaa-4d77-bcd7-086ce1938162 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:29.203403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-09de9faf-bbaa-4d77-bcd7-086ce1938162 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:29.211152 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-09de9faf-bbaa-4d77-bcd7-086ce1938162 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.190267 Jul 04 04:15:29.211767 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 74/158] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:29 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:29.354727 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-860070f8-36d1-4859-92e3-79cb4649dec2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:29.355508 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-860070f8-36d1-4859-92e3-79cb4649dec2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:29.362438 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-860070f8-36d1-4859-92e3-79cb4649dec2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:29.363059 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-860070f8-36d1-4859-92e3-79cb4649dec2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:29.363820 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-860070f8-36d1-4859-92e3-79cb4649dec2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:29.364245 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-860070f8-36d1-4859-92e3-79cb4649dec2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:29.383919 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=100 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:29.502542 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-860070f8-36d1-4859-92e3-79cb4649dec2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:29.513015 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-860070f8-36d1-4859-92e3-79cb4649dec2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.162377 Jul 04 04:15:29.513603 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 85/159] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:29 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:29.569827 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c5f39bc8-9196-4c85-83cb-1e8e3377af31 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:29.570559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c5f39bc8-9196-4c85-83cb-1e8e3377af31 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:29.572433 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=82 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:29.577992 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5f39bc8-9196-4c85-83cb-1e8e3377af31 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:29.578783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5f39bc8-9196-4c85-83cb-1e8e3377af31 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:29.579603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5f39bc8-9196-4c85-83cb-1e8e3377af31 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:29.580277 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5f39bc8-9196-4c85-83cb-1e8e3377af31 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:29.785819 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c5f39bc8-9196-4c85-83cb-1e8e3377af31 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:29.794893 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c5f39bc8-9196-4c85-83cb-1e8e3377af31 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.228793 Jul 04 04:15:29.795477 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 75/160] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:29 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:30.228954 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3f4a0875-b09d-46e2-98ae-9c438e29a4ac tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:30.229568 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-3f4a0875-b09d-46e2-98ae-9c438e29a4ac tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:30.237478 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3f4a0875-b09d-46e2-98ae-9c438e29a4ac tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:30.237932 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3f4a0875-b09d-46e2-98ae-9c438e29a4ac tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:30.238752 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3f4a0875-b09d-46e2-98ae-9c438e29a4ac tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:30.239185 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3f4a0875-b09d-46e2-98ae-9c438e29a4ac tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:30.369346 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-3f4a0875-b09d-46e2-98ae-9c438e29a4ac tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:30.376967 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3f4a0875-b09d-46e2-98ae-9c438e29a4ac tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.152108 Jul 04 04:15:30.377593 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 86/161] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:30 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:30.530627 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bac7e6da-4deb-4a22-9193-2d07f64623a0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:30.531337 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bac7e6da-4deb-4a22-9193-2d07f64623a0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:30.538866 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bac7e6da-4deb-4a22-9193-2d07f64623a0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:30.539313 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bac7e6da-4deb-4a22-9193-2d07f64623a0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:30.540088 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bac7e6da-4deb-4a22-9193-2d07f64623a0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:30.540519 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bac7e6da-4deb-4a22-9193-2d07f64623a0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:30.682533 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bac7e6da-4deb-4a22-9193-2d07f64623a0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:30.694918 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bac7e6da-4deb-4a22-9193-2d07f64623a0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.168036 Jul 04 04:15:30.695419 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 76/162] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:30 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:30.812305 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c8517159-4fea-4ebb-9783-07ec336d58f5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:30.812907 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c8517159-4fea-4ebb-9783-07ec336d58f5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:30.819219 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c8517159-4fea-4ebb-9783-07ec336d58f5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:30.819662 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c8517159-4fea-4ebb-9783-07ec336d58f5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:30.820414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c8517159-4fea-4ebb-9783-07ec336d58f5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:30.820836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c8517159-4fea-4ebb-9783-07ec336d58f5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:30.961477 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c8517159-4fea-4ebb-9783-07ec336d58f5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:30.971160 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c8517159-4fea-4ebb-9783-07ec336d58f5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.162267 Jul 04 04:15:30.971979 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 87/163] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:30 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:31.397381 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0fb1f12c-6fb5-42ee-98fd-b0c704f622a9 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:31.398205 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0fb1f12c-6fb5-42ee-98fd-b0c704f622a9 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:31.409994 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fb1f12c-6fb5-42ee-98fd-b0c704f622a9 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:31.410468 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fb1f12c-6fb5-42ee-98fd-b0c704f622a9 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:31.417377 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fb1f12c-6fb5-42ee-98fd-b0c704f622a9 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:31.418007 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fb1f12c-6fb5-42ee-98fd-b0c704f622a9 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:31.716979 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ce30f313-cd39-4f14-be56-ada84b349a25 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:31.718345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-ce30f313-cd39-4f14-be56-ada84b349a25 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:31.741185 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ce30f313-cd39-4f14-be56-ada84b349a25 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:31.742629 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ce30f313-cd39-4f14-be56-ada84b349a25 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:31.744726 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ce30f313-cd39-4f14-be56-ada84b349a25 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:31.745525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ce30f313-cd39-4f14-be56-ada84b349a25 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:31.887342 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-ce30f313-cd39-4f14-be56-ada84b349a25 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:31.895919 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ce30f313-cd39-4f14-be56-ada84b349a25 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.188215 Jul 04 04:15:31.896504 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 88/164] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:31 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:31.990028 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f0dee8a5-562f-45d5-bfd2-030c57d7b2d3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:31.990594 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f0dee8a5-562f-45d5-bfd2-030c57d7b2d3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:31.998803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f0dee8a5-562f-45d5-bfd2-030c57d7b2d3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:31.999345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f0dee8a5-562f-45d5-bfd2-030c57d7b2d3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:32.000408 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f0dee8a5-562f-45d5-bfd2-030c57d7b2d3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:32.001219 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f0dee8a5-562f-45d5-bfd2-030c57d7b2d3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:32.004484 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0fb1f12c-6fb5-42ee-98fd-b0c704f622a9 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:32.012775 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0fb1f12c-6fb5-42ee-98fd-b0c704f622a9 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.622588 Jul 04 04:15:32.013354 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 77/165] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:31 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:32.136028 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f0dee8a5-562f-45d5-bfd2-030c57d7b2d3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:32.144086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-f0dee8a5-562f-45d5-bfd2-030c57d7b2d3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.158432 Jul 04 04:15:32.144654 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 89/166] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:31 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:32.913448 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d510b77e-dfad-42bd-8433-bf643bbc3cf3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:32.914296 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d510b77e-dfad-42bd-8433-bf643bbc3cf3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:32.920717 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d510b77e-dfad-42bd-8433-bf643bbc3cf3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:32.921791 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d510b77e-dfad-42bd-8433-bf643bbc3cf3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:32.922752 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d510b77e-dfad-42bd-8433-bf643bbc3cf3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:32.923211 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d510b77e-dfad-42bd-8433-bf643bbc3cf3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:33.046738 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-152666fb-4204-4989-8d94-5298bb73dce8 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:33.048346 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-152666fb-4204-4989-8d94-5298bb73dce8 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:33.063824 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-152666fb-4204-4989-8d94-5298bb73dce8 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:33.064336 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-152666fb-4204-4989-8d94-5298bb73dce8 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:33.065252 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-152666fb-4204-4989-8d94-5298bb73dce8 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:33.065685 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-152666fb-4204-4989-8d94-5298bb73dce8 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:33.128039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d510b77e-dfad-42bd-8433-bf643bbc3cf3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:33.136354 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d510b77e-dfad-42bd-8433-bf643bbc3cf3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.226836 Jul 04 04:15:33.137178 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 78/167] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:32 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:33.161419 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a82c167f-7815-475a-8cda-0c5f8eac9aff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:33.162178 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a82c167f-7815-475a-8cda-0c5f8eac9aff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:33.168071 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a82c167f-7815-475a-8cda-0c5f8eac9aff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:33.168515 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a82c167f-7815-475a-8cda-0c5f8eac9aff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:33.169256 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a82c167f-7815-475a-8cda-0c5f8eac9aff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:33.169675 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a82c167f-7815-475a-8cda-0c5f8eac9aff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:33.255478 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-152666fb-4204-4989-8d94-5298bb73dce8 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:33.264434 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-152666fb-4204-4989-8d94-5298bb73dce8 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.236830 Jul 04 04:15:33.265372 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 90/168] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:33 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:33.312599 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a82c167f-7815-475a-8cda-0c5f8eac9aff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:33.320524 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a82c167f-7815-475a-8cda-0c5f8eac9aff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.163369 Jul 04 04:15:33.321109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 79/169] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:33 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:34.154571 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e8b2f22e-01da-4b39-94ca-de10a45ddcaa tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:34.155175 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e8b2f22e-01da-4b39-94ca-de10a45ddcaa tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:34.161499 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e8b2f22e-01da-4b39-94ca-de10a45ddcaa tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:34.161940 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e8b2f22e-01da-4b39-94ca-de10a45ddcaa tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:34.162730 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e8b2f22e-01da-4b39-94ca-de10a45ddcaa tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:34.163153 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e8b2f22e-01da-4b39-94ca-de10a45ddcaa tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:34.281188 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2e241d61-0b12-4497-a3c4-80ef4a46c99d tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:34.282513 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2e241d61-0b12-4497-a3c4-80ef4a46c99d tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:34.291003 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e241d61-0b12-4497-a3c4-80ef4a46c99d tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:34.291898 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e241d61-0b12-4497-a3c4-80ef4a46c99d tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:34.292690 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e241d61-0b12-4497-a3c4-80ef4a46c99d tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:34.293167 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e241d61-0b12-4497-a3c4-80ef4a46c99d tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:34.294348 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e8b2f22e-01da-4b39-94ca-de10a45ddcaa tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:34.302108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e8b2f22e-01da-4b39-94ca-de10a45ddcaa tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.151435 Jul 04 04:15:34.302639 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 91/170] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:34 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:34.336988 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-da6e4903-a8fe-41af-87bf-dfdfad8cbba2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:34.337597 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-da6e4903-a8fe-41af-87bf-dfdfad8cbba2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:34.343763 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-da6e4903-a8fe-41af-87bf-dfdfad8cbba2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:34.344442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-da6e4903-a8fe-41af-87bf-dfdfad8cbba2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:34.345422 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-da6e4903-a8fe-41af-87bf-dfdfad8cbba2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:34.345872 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-da6e4903-a8fe-41af-87bf-dfdfad8cbba2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:34.443682 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2e241d61-0b12-4497-a3c4-80ef4a46c99d tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:34.451652 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2e241d61-0b12-4497-a3c4-80ef4a46c99d tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.174450 Jul 04 04:15:34.452226 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 80/171] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:34 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:34.479171 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-da6e4903-a8fe-41af-87bf-dfdfad8cbba2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:34.487001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-da6e4903-a8fe-41af-87bf-dfdfad8cbba2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.153883 Jul 04 04:15:34.487556 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 92/172] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:34 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:35.319532 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b0cfb7e7-819b-493a-8795-56a6649f519c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:35.320044 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b0cfb7e7-819b-493a-8795-56a6649f519c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:35.326541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0cfb7e7-819b-493a-8795-56a6649f519c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:35.326987 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0cfb7e7-819b-493a-8795-56a6649f519c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:35.327734 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0cfb7e7-819b-493a-8795-56a6649f519c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:35.328159 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0cfb7e7-819b-493a-8795-56a6649f519c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:35.469353 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1390024d-bdf9-48d2-92eb-0528fc2b0aeb tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:35.470001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-1390024d-bdf9-48d2-92eb-0528fc2b0aeb tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:35.477439 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1390024d-bdf9-48d2-92eb-0528fc2b0aeb tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:35.477893 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1390024d-bdf9-48d2-92eb-0528fc2b0aeb tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:35.478698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1390024d-bdf9-48d2-92eb-0528fc2b0aeb tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:35.479129 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1390024d-bdf9-48d2-92eb-0528fc2b0aeb tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:35.483719 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b0cfb7e7-819b-493a-8795-56a6649f519c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:35.492042 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b0cfb7e7-819b-493a-8795-56a6649f519c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.176685 Jul 04 04:15:35.492618 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 81/173] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:35 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:35.506652 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bc1d3e79-4b3a-49b7-a783-a3b09beea29d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:35.507335 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bc1d3e79-4b3a-49b7-a783-a3b09beea29d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:35.518272 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc1d3e79-4b3a-49b7-a783-a3b09beea29d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:35.518804 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc1d3e79-4b3a-49b7-a783-a3b09beea29d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:35.519633 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc1d3e79-4b3a-49b7-a783-a3b09beea29d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:35.520130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc1d3e79-4b3a-49b7-a783-a3b09beea29d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:35.623700 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-1390024d-bdf9-48d2-92eb-0528fc2b0aeb tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:35.636054 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-1390024d-bdf9-48d2-92eb-0528fc2b0aeb tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.170717 Jul 04 04:15:35.637173 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 93/174] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:35 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:35.685316 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bc1d3e79-4b3a-49b7-a783-a3b09beea29d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:35.696059 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bc1d3e79-4b3a-49b7-a783-a3b09beea29d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.194721 Jul 04 04:15:35.696926 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 82/175] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:35 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:36.508555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a79d4cfd-289d-47ec-be50-b59e96908474 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:36.509214 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a79d4cfd-289d-47ec-be50-b59e96908474 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:36.515598 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a79d4cfd-289d-47ec-be50-b59e96908474 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:36.516270 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a79d4cfd-289d-47ec-be50-b59e96908474 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:36.517013 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a79d4cfd-289d-47ec-be50-b59e96908474 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:36.517460 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a79d4cfd-289d-47ec-be50-b59e96908474 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:36.653868 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6ab6b6d3-96bf-4083-9738-3b5689ea90e6 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:36.654862 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6ab6b6d3-96bf-4083-9738-3b5689ea90e6 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:36.667962 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ab6b6d3-96bf-4083-9738-3b5689ea90e6 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:36.668186 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a79d4cfd-289d-47ec-be50-b59e96908474 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:36.668409 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ab6b6d3-96bf-4083-9738-3b5689ea90e6 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:36.669183 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ab6b6d3-96bf-4083-9738-3b5689ea90e6 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:36.669611 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ab6b6d3-96bf-4083-9738-3b5689ea90e6 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:36.677738 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a79d4cfd-289d-47ec-be50-b59e96908474 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.173045 Jul 04 04:15:36.678442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 94/176] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:36 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:36.716775 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b6fdfb36-b3f1-46d0-ae2e-454cd4a188ce tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:36.717382 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b6fdfb36-b3f1-46d0-ae2e-454cd4a188ce tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:36.724288 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b6fdfb36-b3f1-46d0-ae2e-454cd4a188ce tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:36.724736 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b6fdfb36-b3f1-46d0-ae2e-454cd4a188ce tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:36.725537 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b6fdfb36-b3f1-46d0-ae2e-454cd4a188ce tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:36.725971 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b6fdfb36-b3f1-46d0-ae2e-454cd4a188ce tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:36.832436 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6ab6b6d3-96bf-4083-9738-3b5689ea90e6 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:36.840612 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6ab6b6d3-96bf-4083-9738-3b5689ea90e6 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.191463 Jul 04 04:15:36.841336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 83/177] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:36 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:36.864564 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b6fdfb36-b3f1-46d0-ae2e-454cd4a188ce tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:36.871977 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b6fdfb36-b3f1-46d0-ae2e-454cd4a188ce tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.159065 Jul 04 04:15:36.872541 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 95/178] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:36 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:37.698078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-87fbcc9d-a738-48f2-9186-029e39632a94 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:37.698739 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-87fbcc9d-a738-48f2-9186-029e39632a94 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:37.706949 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87fbcc9d-a738-48f2-9186-029e39632a94 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:37.707396 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87fbcc9d-a738-48f2-9186-029e39632a94 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:37.708409 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87fbcc9d-a738-48f2-9186-029e39632a94 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:37.708843 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87fbcc9d-a738-48f2-9186-029e39632a94 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:37.855013 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-87fbcc9d-a738-48f2-9186-029e39632a94 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:37.862154 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-012aabb3-a205-4796-979a-bde2d25bb9b7 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:37.863415 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-012aabb3-a205-4796-979a-bde2d25bb9b7 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:37.864598 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-87fbcc9d-a738-48f2-9186-029e39632a94 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.172301 Jul 04 04:15:37.871958 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-012aabb3-a205-4796-979a-bde2d25bb9b7 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:37.872559 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-012aabb3-a205-4796-979a-bde2d25bb9b7 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:37.873338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-012aabb3-a205-4796-979a-bde2d25bb9b7 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:37.873771 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-012aabb3-a205-4796-979a-bde2d25bb9b7 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:37.874829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 84/179] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:37 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:37.889552 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-37a30d14-2dfe-411f-832d-d62a2ab5ea60 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:37.891766 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-37a30d14-2dfe-411f-832d-d62a2ab5ea60 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:37.901885 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37a30d14-2dfe-411f-832d-d62a2ab5ea60 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:37.902496 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37a30d14-2dfe-411f-832d-d62a2ab5ea60 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:37.903523 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37a30d14-2dfe-411f-832d-d62a2ab5ea60 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:37.903893 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37a30d14-2dfe-411f-832d-d62a2ab5ea60 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:38.023667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-012aabb3-a205-4796-979a-bde2d25bb9b7 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:38.032588 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-012aabb3-a205-4796-979a-bde2d25bb9b7 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.177874 Jul 04 04:15:38.033585 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 96/180] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:37 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:38.105759 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-37a30d14-2dfe-411f-832d-d62a2ab5ea60 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:38.115071 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-37a30d14-2dfe-411f-832d-d62a2ab5ea60 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.229546 Jul 04 04:15:38.115664 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 85/181] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:37 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:38.882846 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c1fb068f-ec1a-4dbe-b188-ddbfa3f391f9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:38.884184 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c1fb068f-ec1a-4dbe-b188-ddbfa3f391f9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:38.895238 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c1fb068f-ec1a-4dbe-b188-ddbfa3f391f9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:38.895760 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c1fb068f-ec1a-4dbe-b188-ddbfa3f391f9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:38.896531 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c1fb068f-ec1a-4dbe-b188-ddbfa3f391f9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:38.897121 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c1fb068f-ec1a-4dbe-b188-ddbfa3f391f9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:39.048213 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c1fb068f-ec1a-4dbe-b188-ddbfa3f391f9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:39.051854 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3db2d46d-84b2-4cb9-aabe-228372f3c0aa tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:39.053056 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3db2d46d-84b2-4cb9-aabe-228372f3c0aa tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:39.057347 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c1fb068f-ec1a-4dbe-b188-ddbfa3f391f9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.178967 Jul 04 04:15:39.060703 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3db2d46d-84b2-4cb9-aabe-228372f3c0aa tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:39.061332 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3db2d46d-84b2-4cb9-aabe-228372f3c0aa tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:39.062254 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3db2d46d-84b2-4cb9-aabe-228372f3c0aa tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:39.062839 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3db2d46d-84b2-4cb9-aabe-228372f3c0aa tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:39.067506 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 97/182] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:38 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:39.142724 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d9cfe31e-6efc-4d3f-bd48-76956047b0ca tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:39.143472 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d9cfe31e-6efc-4d3f-bd48-76956047b0ca tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:39.150272 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d9cfe31e-6efc-4d3f-bd48-76956047b0ca tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:39.151586 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d9cfe31e-6efc-4d3f-bd48-76956047b0ca tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:39.152451 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d9cfe31e-6efc-4d3f-bd48-76956047b0ca tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:39.152971 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d9cfe31e-6efc-4d3f-bd48-76956047b0ca tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:39.273019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3db2d46d-84b2-4cb9-aabe-228372f3c0aa tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:39.282183 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3db2d46d-84b2-4cb9-aabe-228372f3c0aa tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.234586 Jul 04 04:15:39.282961 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 86/183] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:39 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:39.320815 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d9cfe31e-6efc-4d3f-bd48-76956047b0ca tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:39.330003 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d9cfe31e-6efc-4d3f-bd48-76956047b0ca tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.198498 Jul 04 04:15:39.330759 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 98/184] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:39 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:40.074718 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-16ff4e9a-d82c-4b2f-ac69-ef94659ab977 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:40.075286 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-16ff4e9a-d82c-4b2f-ac69-ef94659ab977 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:40.081768 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16ff4e9a-d82c-4b2f-ac69-ef94659ab977 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:40.082246 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16ff4e9a-d82c-4b2f-ac69-ef94659ab977 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:40.083045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16ff4e9a-d82c-4b2f-ac69-ef94659ab977 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:40.083691 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16ff4e9a-d82c-4b2f-ac69-ef94659ab977 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:40.219277 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-16ff4e9a-d82c-4b2f-ac69-ef94659ab977 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:40.227130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-16ff4e9a-d82c-4b2f-ac69-ef94659ab977 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.156586 Jul 04 04:15:40.227742 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 87/185] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:40 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:40.300667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9f594464-bcc8-4a7a-b667-6e810313163f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:40.301274 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-9f594464-bcc8-4a7a-b667-6e810313163f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:40.304407 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=80 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:40.309220 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9f594464-bcc8-4a7a-b667-6e810313163f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:40.309727 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9f594464-bcc8-4a7a-b667-6e810313163f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:40.310625 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9f594464-bcc8-4a7a-b667-6e810313163f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:40.311077 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9f594464-bcc8-4a7a-b667-6e810313163f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:40.347013 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-51f89932-52e5-491d-a14e-2b0d8069787c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:40.347855 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-51f89932-52e5-491d-a14e-2b0d8069787c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:40.354387 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51f89932-52e5-491d-a14e-2b0d8069787c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:40.354830 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51f89932-52e5-491d-a14e-2b0d8069787c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:40.355678 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51f89932-52e5-491d-a14e-2b0d8069787c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:40.356082 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51f89932-52e5-491d-a14e-2b0d8069787c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:40.447016 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9f594464-bcc8-4a7a-b667-6e810313163f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:40.454468 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9f594464-bcc8-4a7a-b667-6e810313163f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.158722 Jul 04 04:15:40.455037 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 99/186] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:40 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:40.546609 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-51f89932-52e5-491d-a14e-2b0d8069787c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:40.555066 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-51f89932-52e5-491d-a14e-2b0d8069787c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.211730 Jul 04 04:15:40.555771 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 88/187] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:40 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:41.244431 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-6ee702db-6165-4c34-ae01-003a55e0e44a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:41.245052 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-6ee702db-6165-4c34-ae01-003a55e0e44a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:41.252059 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6ee702db-6165-4c34-ae01-003a55e0e44a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:41.252545 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6ee702db-6165-4c34-ae01-003a55e0e44a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:41.253310 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6ee702db-6165-4c34-ae01-003a55e0e44a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:41.253699 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6ee702db-6165-4c34-ae01-003a55e0e44a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:41.410344 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-6ee702db-6165-4c34-ae01-003a55e0e44a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:41.420342 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-6ee702db-6165-4c34-ae01-003a55e0e44a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.180125 Jul 04 04:15:41.421309 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 100/188] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:41 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:41.472076 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7cfd7bfe-2a3e-4542-af77-97b5c8982ba7 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:41.472781 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7cfd7bfe-2a3e-4542-af77-97b5c8982ba7 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:41.479046 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7cfd7bfe-2a3e-4542-af77-97b5c8982ba7 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:41.479616 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7cfd7bfe-2a3e-4542-af77-97b5c8982ba7 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:41.480615 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7cfd7bfe-2a3e-4542-af77-97b5c8982ba7 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:41.481120 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7cfd7bfe-2a3e-4542-af77-97b5c8982ba7 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:41.572907 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b37d8cc1-709a-4f2a-8f94-46ba5700ce38 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:41.573478 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b37d8cc1-709a-4f2a-8f94-46ba5700ce38 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:41.579706 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b37d8cc1-709a-4f2a-8f94-46ba5700ce38 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:41.580157 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b37d8cc1-709a-4f2a-8f94-46ba5700ce38 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:41.580925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b37d8cc1-709a-4f2a-8f94-46ba5700ce38 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:41.581353 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b37d8cc1-709a-4f2a-8f94-46ba5700ce38 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:41.619031 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7cfd7bfe-2a3e-4542-af77-97b5c8982ba7 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:41.627296 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7cfd7bfe-2a3e-4542-af77-97b5c8982ba7 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.159325 Jul 04 04:15:41.636916 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 89/189] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:41 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:41.720539 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b37d8cc1-709a-4f2a-8f94-46ba5700ce38 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:41.728307 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b37d8cc1-709a-4f2a-8f94-46ba5700ce38 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.159150 Jul 04 04:15:41.728873 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 101/190] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:41 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:42.442411 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dbcae7a9-9576-4b13-afc6-35de65b4114e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:42.443000 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dbcae7a9-9576-4b13-afc6-35de65b4114e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:42.449282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dbcae7a9-9576-4b13-afc6-35de65b4114e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:42.449743 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dbcae7a9-9576-4b13-afc6-35de65b4114e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:42.450547 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dbcae7a9-9576-4b13-afc6-35de65b4114e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:42.450960 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dbcae7a9-9576-4b13-afc6-35de65b4114e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:42.468840 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:42.587588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dbcae7a9-9576-4b13-afc6-35de65b4114e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:42.595367 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dbcae7a9-9576-4b13-afc6-35de65b4114e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.157245 Jul 04 04:15:42.596173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 90/191] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:42 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:42.644521 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-93c92683-902e-4140-ab1f-8669c3d2305f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:42.645140 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-93c92683-902e-4140-ab1f-8669c3d2305f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:42.651372 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-93c92683-902e-4140-ab1f-8669c3d2305f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:42.651875 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-93c92683-902e-4140-ab1f-8669c3d2305f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:42.652622 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-93c92683-902e-4140-ab1f-8669c3d2305f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:42.653227 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-93c92683-902e-4140-ab1f-8669c3d2305f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:42.658628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=100 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:42.745554 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b006ecd1-bddd-4d68-9ade-204f3fde04b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:42.746701 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b006ecd1-bddd-4d68-9ade-204f3fde04b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:42.753744 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b006ecd1-bddd-4d68-9ade-204f3fde04b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:42.754292 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b006ecd1-bddd-4d68-9ade-204f3fde04b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:42.755319 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b006ecd1-bddd-4d68-9ade-204f3fde04b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:42.755848 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b006ecd1-bddd-4d68-9ade-204f3fde04b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:42.784380 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-93c92683-902e-4140-ab1f-8669c3d2305f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:42.793323 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-93c92683-902e-4140-ab1f-8669c3d2305f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.152671 Jul 04 04:15:42.793984 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 102/192] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:42 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:42.899345 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b006ecd1-bddd-4d68-9ade-204f3fde04b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:42.906855 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b006ecd1-bddd-4d68-9ade-204f3fde04b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.165608 Jul 04 04:15:42.907564 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 91/193] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:42 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:43.613562 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7b2ee4b9-dd1b-495b-93a0-24a0da300487 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:43.614259 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7b2ee4b9-dd1b-495b-93a0-24a0da300487 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:43.621313 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7b2ee4b9-dd1b-495b-93a0-24a0da300487 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:43.621751 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7b2ee4b9-dd1b-495b-93a0-24a0da300487 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:43.622621 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7b2ee4b9-dd1b-495b-93a0-24a0da300487 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:43.623262 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7b2ee4b9-dd1b-495b-93a0-24a0da300487 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:43.779544 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7b2ee4b9-dd1b-495b-93a0-24a0da300487 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:43.789052 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7b2ee4b9-dd1b-495b-93a0-24a0da300487 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1322 microversion: 2.1 time: 0.180548 Jul 04 04:15:43.790152 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 103/194] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:43 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:43.813022 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-01418630-9514-43e8-95e3-a9acc606cbd0 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:43.813831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-01418630-9514-43e8-95e3-a9acc606cbd0 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:43.820891 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01418630-9514-43e8-95e3-a9acc606cbd0 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:43.821359 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01418630-9514-43e8-95e3-a9acc606cbd0 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:43.822361 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01418630-9514-43e8-95e3-a9acc606cbd0 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:43.822943 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01418630-9514-43e8-95e3-a9acc606cbd0 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:43.926461 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-8b01848c-5129-43ad-869d-051173b27fd2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:43.928102 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-8b01848c-5129-43ad-869d-051173b27fd2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:43.935291 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8b01848c-5129-43ad-869d-051173b27fd2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:43.935892 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8b01848c-5129-43ad-869d-051173b27fd2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:43.936669 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8b01848c-5129-43ad-869d-051173b27fd2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:43.937093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8b01848c-5129-43ad-869d-051173b27fd2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:44.021624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-01418630-9514-43e8-95e3-a9acc606cbd0 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:44.029341 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-01418630-9514-43e8-95e3-a9acc606cbd0 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.221318 Jul 04 04:15:44.029909 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 92/195] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:43 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:44.113505 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-8b01848c-5129-43ad-869d-051173b27fd2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:44.124045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-8b01848c-5129-43ad-869d-051173b27fd2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.203269 Jul 04 04:15:44.124676 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 104/196] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:43 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:44.147213 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-ddbb9bcb-35ec-4edd-823c-d102ab2f8628 req-c3bd2995-ff96-4b2e-8348-943a30f29823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be90f3f9-d0dd-4296-ba6b-dc719d491a12", "name": "network-vif-plugged", "status": "completed", "tag": "9e8db02a-f437-48df-a498-4ab55ec549fb"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:15:44.158492 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ddbb9bcb-35ec-4edd-823c-d102ab2f8628 req-c3bd2995-ff96-4b2e-8348-943a30f29823 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:44.164442 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ddbb9bcb-35ec-4edd-823c-d102ab2f8628 req-c3bd2995-ff96-4b2e-8348-943a30f29823 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:44.195833 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-ddbb9bcb-35ec-4edd-823c-d102ab2f8628 req-c3bd2995-ff96-4b2e-8348-943a30f29823 service nova] Creating event network-vif-plugged:9e8db02a-f437-48df-a498-4ab55ec549fb for instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 on hv-cinder-74216 Jul 04 04:15:44.203730 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-ddbb9bcb-35ec-4edd-823c-d102ab2f8628 req-c3bd2995-ff96-4b2e-8348-943a30f29823 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061215 Jul 04 04:15:44.207072 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 93/197] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:15:44.806994 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-8f47dd03-5057-4618-9ace-1ede167c91fc tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:44.807723 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-8f47dd03-5057-4618-9ace-1ede167c91fc tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:44.815324 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8f47dd03-5057-4618-9ace-1ede167c91fc tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:44.815813 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8f47dd03-5057-4618-9ace-1ede167c91fc tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:44.816625 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8f47dd03-5057-4618-9ace-1ede167c91fc tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:44.817108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8f47dd03-5057-4618-9ace-1ede167c91fc tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:44.964106 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-8f47dd03-5057-4618-9ace-1ede167c91fc tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:44.975018 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-8f47dd03-5057-4618-9ace-1ede167c91fc tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1517 microversion: 2.1 time: 0.172340 Jul 04 04:15:44.987343 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 105/198] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:44 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1517 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:44.993145 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f44cd29a-fb4e-4316-933d-5b0229447d99 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:15:44.994891 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f44cd29a-fb4e-4316-933d-5b0229447d99 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:45.001720 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f44cd29a-fb4e-4316-933d-5b0229447d99 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:45.002159 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f44cd29a-fb4e-4316-933d-5b0229447d99 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:45.003000 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f44cd29a-fb4e-4316-933d-5b0229447d99 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:45.003632 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f44cd29a-fb4e-4316-933d-5b0229447d99 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:45.049213 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f7fa0c3b-15ad-404b-8bad-2ab6af6cc4f2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:45.050729 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f7fa0c3b-15ad-404b-8bad-2ab6af6cc4f2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:45.061523 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f7fa0c3b-15ad-404b-8bad-2ab6af6cc4f2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:45.062664 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f7fa0c3b-15ad-404b-8bad-2ab6af6cc4f2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:45.064623 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f7fa0c3b-15ad-404b-8bad-2ab6af6cc4f2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:45.065526 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f7fa0c3b-15ad-404b-8bad-2ab6af6cc4f2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:45.071490 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-f44cd29a-fb4e-4316-933d-5b0229447d99 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lazy-loading 'flavor' on Instance uuid 314d0a92-11cc-45ac-b70b-1c65f66ecfc4 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:15:45.227467 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f44cd29a-fb4e-4316-933d-5b0229447d99 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "POST /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4/action" status: 200 len: 32 microversion: 2.1 time: 0.236230 Jul 04 04:15:45.227849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 94/199] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 4 04:15:44 2022] POST /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4/action => generated 32 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 04 04:15:45.237773 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6b3c9654-4fe4-473f-ac3d-3f42b1b05c9d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:45.238526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6b3c9654-4fe4-473f-ac3d-3f42b1b05c9d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:45.246511 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b3c9654-4fe4-473f-ac3d-3f42b1b05c9d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:45.246957 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b3c9654-4fe4-473f-ac3d-3f42b1b05c9d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:45.247724 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b3c9654-4fe4-473f-ac3d-3f42b1b05c9d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:45.248149 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b3c9654-4fe4-473f-ac3d-3f42b1b05c9d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:45.255854 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f7fa0c3b-15ad-404b-8bad-2ab6af6cc4f2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:45.266406 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-f7fa0c3b-15ad-404b-8bad-2ab6af6cc4f2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.222865 Jul 04 04:15:45.267232 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 106/200] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:45 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:45.289162 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f656c51c-33a5-4535-88ae-bb93ade5b2f8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:45.296038 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f656c51c-33a5-4535-88ae-bb93ade5b2f8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:45.310034 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f656c51c-33a5-4535-88ae-bb93ade5b2f8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:45.310575 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f656c51c-33a5-4535-88ae-bb93ade5b2f8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:45.311597 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f656c51c-33a5-4535-88ae-bb93ade5b2f8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:45.312205 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f656c51c-33a5-4535-88ae-bb93ade5b2f8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:45.520750 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f656c51c-33a5-4535-88ae-bb93ade5b2f8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:45.531799 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6b3c9654-4fe4-473f-ac3d-3f42b1b05c9d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:45.533805 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-f656c51c-33a5-4535-88ae-bb93ade5b2f8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.264392 Jul 04 04:15:45.541972 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6b3c9654-4fe4-473f-ac3d-3f42b1b05c9d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.310223 Jul 04 04:15:45.544777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 107/201] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:45 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:45.547490 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 95/202] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:45 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:46.283450 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-96cb1fcb-4430-4e1d-843f-3dcc91e2a69a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:46.284085 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-96cb1fcb-4430-4e1d-843f-3dcc91e2a69a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:46.292601 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-96cb1fcb-4430-4e1d-843f-3dcc91e2a69a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:46.293047 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-96cb1fcb-4430-4e1d-843f-3dcc91e2a69a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:46.293817 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-96cb1fcb-4430-4e1d-843f-3dcc91e2a69a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:46.294242 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-96cb1fcb-4430-4e1d-843f-3dcc91e2a69a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:46.498355 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-96cb1fcb-4430-4e1d-843f-3dcc91e2a69a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:46.511024 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-96cb1fcb-4430-4e1d-843f-3dcc91e2a69a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.231416 Jul 04 04:15:46.511644 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 108/203] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:46 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:46.554308 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b0aef599-5e31-431a-a4bc-335c1a938b8b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:46.554962 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b0aef599-5e31-431a-a4bc-335c1a938b8b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:46.562760 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0aef599-5e31-431a-a4bc-335c1a938b8b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:46.564182 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0aef599-5e31-431a-a4bc-335c1a938b8b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:46.565154 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0aef599-5e31-431a-a4bc-335c1a938b8b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:46.565264 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9eea68b0-a595-4c82-addc-67cb4e8c491f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:46.565835 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-9eea68b0-a595-4c82-addc-67cb4e8c491f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:46.566441 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0aef599-5e31-431a-a4bc-335c1a938b8b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:46.573452 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9eea68b0-a595-4c82-addc-67cb4e8c491f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:46.574168 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9eea68b0-a595-4c82-addc-67cb4e8c491f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:46.575416 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9eea68b0-a595-4c82-addc-67cb4e8c491f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:46.576475 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9eea68b0-a595-4c82-addc-67cb4e8c491f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:46.737015 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b0aef599-5e31-431a-a4bc-335c1a938b8b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:46.747301 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b0aef599-5e31-431a-a4bc-335c1a938b8b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.197921 Jul 04 04:15:46.748208 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 96/204] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:46 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:46.763348 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9eea68b0-a595-4c82-addc-67cb4e8c491f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:46.772489 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9eea68b0-a595-4c82-addc-67cb4e8c491f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.211718 Jul 04 04:15:46.773594 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 109/205] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:46 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:47.537091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8ca8ec13-4e78-40ab-857d-98d6421b5668 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:47.537091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8ca8ec13-4e78-40ab-857d-98d6421b5668 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:47.539056 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ca8ec13-4e78-40ab-857d-98d6421b5668 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:47.539851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ca8ec13-4e78-40ab-857d-98d6421b5668 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:47.541612 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ca8ec13-4e78-40ab-857d-98d6421b5668 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:47.543716 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ca8ec13-4e78-40ab-857d-98d6421b5668 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:47.702855 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8ca8ec13-4e78-40ab-857d-98d6421b5668 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:47.716299 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8ca8ec13-4e78-40ab-857d-98d6421b5668 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.191527 Jul 04 04:15:47.726782 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 97/206] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:47 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:47.766497 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-73d19cc2-2a3a-44d8-b563-4c0b760d4b62 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:47.767939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-73d19cc2-2a3a-44d8-b563-4c0b760d4b62 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:47.775309 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-73d19cc2-2a3a-44d8-b563-4c0b760d4b62 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:47.776089 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-73d19cc2-2a3a-44d8-b563-4c0b760d4b62 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:47.777427 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-73d19cc2-2a3a-44d8-b563-4c0b760d4b62 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:47.778996 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-73d19cc2-2a3a-44d8-b563-4c0b760d4b62 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:47.790972 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-87c092d3-32a1-4085-a7d5-e3d42b536c64 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:47.791649 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-87c092d3-32a1-4085-a7d5-e3d42b536c64 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:47.802273 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87c092d3-32a1-4085-a7d5-e3d42b536c64 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:47.802888 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87c092d3-32a1-4085-a7d5-e3d42b536c64 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:47.804035 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87c092d3-32a1-4085-a7d5-e3d42b536c64 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:47.804985 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87c092d3-32a1-4085-a7d5-e3d42b536c64 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:48.015756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-73d19cc2-2a3a-44d8-b563-4c0b760d4b62 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:48.028186 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-73d19cc2-2a3a-44d8-b563-4c0b760d4b62 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.267271 Jul 04 04:15:48.028787 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 110/207] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:47 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:48.087024 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-87c092d3-32a1-4085-a7d5-e3d42b536c64 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:48.095843 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-87c092d3-32a1-4085-a7d5-e3d42b536c64 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.310230 Jul 04 04:15:48.100145 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 98/208] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:47 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:48.462514 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-297f820b-50a4-42b5-baf4-e80b7441e18d req-3eb3b4ba-24e6-49bd-a797-7e44d7a60ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbd2b17-e16f-4867-87bd-9e0430d8b027", "name": "network-vif-plugged", "status": "completed", "tag": "44387a5e-08a3-462a-be05-f2befd8e7016"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:15:48.476514 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-297f820b-50a4-42b5-baf4-e80b7441e18d req-3eb3b4ba-24e6-49bd-a797-7e44d7a60ae7 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:48.477611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-297f820b-50a4-42b5-baf4-e80b7441e18d req-3eb3b4ba-24e6-49bd-a797-7e44d7a60ae7 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:48.493880 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-297f820b-50a4-42b5-baf4-e80b7441e18d req-3eb3b4ba-24e6-49bd-a797-7e44d7a60ae7 service nova] Creating event network-vif-plugged:44387a5e-08a3-462a-be05-f2befd8e7016 for instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 on hv-cinder-74216 Jul 04 04:15:48.502952 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-297f820b-50a4-42b5-baf4-e80b7441e18d req-3eb3b4ba-24e6-49bd-a797-7e44d7a60ae7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044497 Jul 04 04:15:48.503570 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 111/209] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:15:48.732872 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d407573f-d6f7-46c7-ad9a-ea9154c864f6 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:48.733479 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d407573f-d6f7-46c7-ad9a-ea9154c864f6 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:48.767596 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d407573f-d6f7-46c7-ad9a-ea9154c864f6 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:48.769582 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d407573f-d6f7-46c7-ad9a-ea9154c864f6 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:48.771610 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d407573f-d6f7-46c7-ad9a-ea9154c864f6 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:48.772202 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d407573f-d6f7-46c7-ad9a-ea9154c864f6 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:49.047397 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-4f5f1e5c-5bb7-4b0f-ae2e-a242bc2d4d2c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:49.049095 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-4f5f1e5c-5bb7-4b0f-ae2e-a242bc2d4d2c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:49.061988 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4f5f1e5c-5bb7-4b0f-ae2e-a242bc2d4d2c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:49.064393 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4f5f1e5c-5bb7-4b0f-ae2e-a242bc2d4d2c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:49.067602 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4f5f1e5c-5bb7-4b0f-ae2e-a242bc2d4d2c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:49.068533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4f5f1e5c-5bb7-4b0f-ae2e-a242bc2d4d2c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:49.227730 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d407573f-d6f7-46c7-ad9a-ea9154c864f6 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:49.235840 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d407573f-d6f7-46c7-ad9a-ea9154c864f6 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.506622 Jul 04 04:15:49.238801 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 99/210] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:48 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:49.255644 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-92756479-a126-4c09-a570-6e48fc8cdf6d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:49.257150 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-92756479-a126-4c09-a570-6e48fc8cdf6d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:49.266058 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92756479-a126-4c09-a570-6e48fc8cdf6d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:49.267511 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92756479-a126-4c09-a570-6e48fc8cdf6d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:49.268507 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92756479-a126-4c09-a570-6e48fc8cdf6d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:49.269452 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92756479-a126-4c09-a570-6e48fc8cdf6d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:49.290732 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-4f5f1e5c-5bb7-4b0f-ae2e-a242bc2d4d2c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:49.302566 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-4f5f1e5c-5bb7-4b0f-ae2e-a242bc2d4d2c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.258902 Jul 04 04:15:49.303799 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 112/211] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:49 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:49.542836 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-92756479-a126-4c09-a570-6e48fc8cdf6d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:49.551511 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-92756479-a126-4c09-a570-6e48fc8cdf6d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1365 microversion: 2.1 time: 0.306997 Jul 04 04:15:49.552076 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 100/212] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:49 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1365 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:50.256595 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-0eb4db27-651c-47c4-a425-a147006826c4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:50.257828 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-0eb4db27-651c-47c4-a425-a147006826c4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:50.268133 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0eb4db27-651c-47c4-a425-a147006826c4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:50.269292 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0eb4db27-651c-47c4-a425-a147006826c4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:50.292842 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0eb4db27-651c-47c4-a425-a147006826c4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:50.292842 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0eb4db27-651c-47c4-a425-a147006826c4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:50.322583 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ceb86a0f-311c-4e69-9589-1481c7ab069f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:50.323977 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ceb86a0f-311c-4e69-9589-1481c7ab069f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:50.337052 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ceb86a0f-311c-4e69-9589-1481c7ab069f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:50.339314 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ceb86a0f-311c-4e69-9589-1481c7ab069f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:50.341201 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ceb86a0f-311c-4e69-9589-1481c7ab069f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:50.341886 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ceb86a0f-311c-4e69-9589-1481c7ab069f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:50.680744 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-0eb4db27-651c-47c4-a425-a147006826c4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:50.694730 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-0eb4db27-651c-47c4-a425-a147006826c4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.442990 Jul 04 04:15:50.695364 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 113/213] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:50 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:50.726076 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-c76e9743-aa41-4ea9-9e0b-fdb3f42d0dd4 req-89e4dc6c-788a-406d-b8e5-edb1b0e1fce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e519dd6-a044-4afa-ac1b-bf1f53611738", "name": "network-vif-plugged", "status": "completed", "tag": "3384abec-b08a-4477-8514-51d16c8ee80f"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:15:50.752791 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-c76e9743-aa41-4ea9-9e0b-fdb3f42d0dd4 req-89e4dc6c-788a-406d-b8e5-edb1b0e1fce9 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:50.755204 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-c76e9743-aa41-4ea9-9e0b-fdb3f42d0dd4 req-89e4dc6c-788a-406d-b8e5-edb1b0e1fce9 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:50.770172 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ceb86a0f-311c-4e69-9589-1481c7ab069f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:50.783749 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-c76e9743-aa41-4ea9-9e0b-fdb3f42d0dd4 req-89e4dc6c-788a-406d-b8e5-edb1b0e1fce9 service nova] Creating event network-vif-plugged:3384abec-b08a-4477-8514-51d16c8ee80f for instance 6e519dd6-a044-4afa-ac1b-bf1f53611738 on hv-cinder-74216 Jul 04 04:15:50.786020 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ceb86a0f-311c-4e69-9589-1481c7ab069f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.467937 Jul 04 04:15:50.789530 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 101/214] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:50 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:50.789968 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-c76e9743-aa41-4ea9-9e0b-fdb3f42d0dd4 req-89e4dc6c-788a-406d-b8e5-edb1b0e1fce9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092694 Jul 04 04:15:50.790508 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 114/215] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:15:50.795490 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b0e00c2c-8677-44db-a100-d0f8411d0b77 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:50.796392 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b0e00c2c-8677-44db-a100-d0f8411d0b77 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:50.809974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0e00c2c-8677-44db-a100-d0f8411d0b77 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:50.810717 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0e00c2c-8677-44db-a100-d0f8411d0b77 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:50.812492 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0e00c2c-8677-44db-a100-d0f8411d0b77 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:50.812969 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0e00c2c-8677-44db-a100-d0f8411d0b77 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:50.992007 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b0e00c2c-8677-44db-a100-d0f8411d0b77 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:50.999823 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b0e00c2c-8677-44db-a100-d0f8411d0b77 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1555 microversion: 2.1 time: 0.208392 Jul 04 04:15:51.000744 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 102/216] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:50 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1555 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:51.019838 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-dea2ac8c-cdb0-475e-8dfb-ece3a62f411b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:51.020424 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-dea2ac8c-cdb0-475e-8dfb-ece3a62f411b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:51.033933 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dea2ac8c-cdb0-475e-8dfb-ece3a62f411b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:51.034298 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dea2ac8c-cdb0-475e-8dfb-ece3a62f411b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:51.035135 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dea2ac8c-cdb0-475e-8dfb-ece3a62f411b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:51.035574 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dea2ac8c-cdb0-475e-8dfb-ece3a62f411b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:51.174508 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-dea2ac8c-cdb0-475e-8dfb-ece3a62f411b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160019 Jul 04 04:15:51.179046 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 115/217] 10.222.0.16 () {58 vars in 1274 bytes} [Mon Jul 4 04:15:51 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:15:51.714645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e91f0a9b-706c-4d43-a832-385d7386b117 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:51.715302 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e91f0a9b-706c-4d43-a832-385d7386b117 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:51.734229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e91f0a9b-706c-4d43-a832-385d7386b117 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:51.736114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e91f0a9b-706c-4d43-a832-385d7386b117 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:51.738049 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e91f0a9b-706c-4d43-a832-385d7386b117 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:51.738738 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e91f0a9b-706c-4d43-a832-385d7386b117 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:51.807806 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-49b4f1cd-8438-4c04-a6de-9df41f605fa1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:51.808570 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-49b4f1cd-8438-4c04-a6de-9df41f605fa1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:51.821948 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-49b4f1cd-8438-4c04-a6de-9df41f605fa1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:51.822414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-49b4f1cd-8438-4c04-a6de-9df41f605fa1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:51.823571 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-49b4f1cd-8438-4c04-a6de-9df41f605fa1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:51.826187 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-49b4f1cd-8438-4c04-a6de-9df41f605fa1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:52.068883 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e91f0a9b-706c-4d43-a832-385d7386b117 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:52.082201 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e91f0a9b-706c-4d43-a832-385d7386b117 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1315 microversion: 2.1 time: 0.371586 Jul 04 04:15:52.083383 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 103/218] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:51 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:52.273599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-49b4f1cd-8438-4c04-a6de-9df41f605fa1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:52.287477 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-49b4f1cd-8438-4c04-a6de-9df41f605fa1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.484078 Jul 04 04:15:52.289128 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 116/219] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:51 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:53.099945 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0f3c7903-56be-4b51-bf25-469804ee6767 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:53.100814 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0f3c7903-56be-4b51-bf25-469804ee6767 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:53.116476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f3c7903-56be-4b51-bf25-469804ee6767 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:53.120919 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f3c7903-56be-4b51-bf25-469804ee6767 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:53.121816 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f3c7903-56be-4b51-bf25-469804ee6767 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:53.122444 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f3c7903-56be-4b51-bf25-469804ee6767 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:53.271948 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-2f21633d-1cda-4009-945c-32aaf447dcc5 req-a3eada3c-8f79-4983-a6f9-5037744cedbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be90f3f9-d0dd-4296-ba6b-dc719d491a12", "tag": "9e8db02a-f437-48df-a498-4ab55ec549fb"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:15:53.283215 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-2f21633d-1cda-4009-945c-32aaf447dcc5 req-a3eada3c-8f79-4983-a6f9-5037744cedbe service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:53.284340 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-2f21633d-1cda-4009-945c-32aaf447dcc5 req-a3eada3c-8f79-4983-a6f9-5037744cedbe service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:53.301674 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-2f21633d-1cda-4009-945c-32aaf447dcc5 req-a3eada3c-8f79-4983-a6f9-5037744cedbe service nova] Creating event network-changed:9e8db02a-f437-48df-a498-4ab55ec549fb for instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 on hv-cinder-74216 Jul 04 04:15:53.323135 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-2f21633d-1cda-4009-945c-32aaf447dcc5 req-a3eada3c-8f79-4983-a6f9-5037744cedbe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053493 Jul 04 04:15:53.323418 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 117/220] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:15:53.334767 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f3c7903-56be-4b51-bf25-469804ee6767 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:53.336787 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-40e7dfa7-c5c2-40f8-8f84-9d7e002d605e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:53.337811 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-40e7dfa7-c5c2-40f8-8f84-9d7e002d605e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:53.344313 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0f3c7903-56be-4b51-bf25-469804ee6767 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1501 microversion: 2.1 time: 0.248137 Jul 04 04:15:53.345112 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 104/221] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:53 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1501 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:53.346767 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-40e7dfa7-c5c2-40f8-8f84-9d7e002d605e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:53.347405 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-40e7dfa7-c5c2-40f8-8f84-9d7e002d605e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:53.348275 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-40e7dfa7-c5c2-40f8-8f84-9d7e002d605e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:53.348904 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-40e7dfa7-c5c2-40f8-8f84-9d7e002d605e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:53.617603 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-40e7dfa7-c5c2-40f8-8f84-9d7e002d605e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:53.626525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-40e7dfa7-c5c2-40f8-8f84-9d7e002d605e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.294614 Jul 04 04:15:53.629631 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 118/222] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:53 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:54.649872 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e0d0bcb5-3f74-4713-9ef4-0dc6303f5980 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:54.651744 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e0d0bcb5-3f74-4713-9ef4-0dc6303f5980 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:54.666831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0d0bcb5-3f74-4713-9ef4-0dc6303f5980 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:54.667343 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0d0bcb5-3f74-4713-9ef4-0dc6303f5980 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:54.668200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0d0bcb5-3f74-4713-9ef4-0dc6303f5980 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:54.668641 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e0d0bcb5-3f74-4713-9ef4-0dc6303f5980 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:54.823588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e0d0bcb5-3f74-4713-9ef4-0dc6303f5980 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:54.828343 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:54.833279 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e0d0bcb5-3f74-4713-9ef4-0dc6303f5980 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.191271 Jul 04 04:15:54.833942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 105/223] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:54 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:55.851400 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-246ebc87-81c5-43f7-a394-2925c220e022 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:55.852617 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-246ebc87-81c5-43f7-a394-2925c220e022 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:55.860804 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-246ebc87-81c5-43f7-a394-2925c220e022 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:55.861250 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-246ebc87-81c5-43f7-a394-2925c220e022 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:55.862504 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-246ebc87-81c5-43f7-a394-2925c220e022 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:55.863165 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-246ebc87-81c5-43f7-a394-2925c220e022 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:56.005981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-246ebc87-81c5-43f7-a394-2925c220e022 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:56.014217 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-246ebc87-81c5-43f7-a394-2925c220e022 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.167402 Jul 04 04:15:56.014810 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 119/224] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:55 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:15:57.034388 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1545db02-3946-4889-bf01-1b3bfc024503 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:57.035171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1545db02-3946-4889-bf01-1b3bfc024503 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:57.044372 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1545db02-3946-4889-bf01-1b3bfc024503 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:57.044786 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1545db02-3946-4889-bf01-1b3bfc024503 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:57.045563 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1545db02-3946-4889-bf01-1b3bfc024503 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:57.045989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1545db02-3946-4889-bf01-1b3bfc024503 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:57.206399 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1545db02-3946-4889-bf01-1b3bfc024503 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:57.215931 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1545db02-3946-4889-bf01-1b3bfc024503 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.187679 Jul 04 04:15:57.216518 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 106/225] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:57 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:58.245261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-4a89fbd6-a9dc-4ad5-a2a7-7ab866b0fa34 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:58.245954 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-4a89fbd6-a9dc-4ad5-a2a7-7ab866b0fa34 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:58.255353 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4a89fbd6-a9dc-4ad5-a2a7-7ab866b0fa34 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:58.257036 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4a89fbd6-a9dc-4ad5-a2a7-7ab866b0fa34 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:58.260281 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4a89fbd6-a9dc-4ad5-a2a7-7ab866b0fa34 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:58.262421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4a89fbd6-a9dc-4ad5-a2a7-7ab866b0fa34 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:58.439943 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0d75083f-9ba2-4f7d-bca7-a1170654e1b3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b14e03bb-37c8-46e7-b3d3-1e75b5f1c70e"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:15:58.441210 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0d75083f-9ba2-4f7d-bca7-a1170654e1b3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:58.452955 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d75083f-9ba2-4f7d-bca7-a1170654e1b3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:58.455483 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d75083f-9ba2-4f7d-bca7-a1170654e1b3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:58.457227 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d75083f-9ba2-4f7d-bca7-a1170654e1b3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:58.458266 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d75083f-9ba2-4f7d-bca7-a1170654e1b3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:58.717407 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-4a89fbd6-a9dc-4ad5-a2a7-7ab866b0fa34 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:15:58.725146 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-4a89fbd6-a9dc-4ad5-a2a7-7ab866b0fa34 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.493397 Jul 04 04:15:58.725799 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 120/226] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:58 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:15:59.742289 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7f31f820-0661-481a-ae85-08a7948a670d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:15:59.743079 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7f31f820-0661-481a-ae85-08a7948a670d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:15:59.756418 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7f31f820-0661-481a-ae85-08a7948a670d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:59.756869 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7f31f820-0661-481a-ae85-08a7948a670d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:59.757651 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7f31f820-0661-481a-ae85-08a7948a670d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:15:59.758084 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7f31f820-0661-481a-ae85-08a7948a670d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:15:59.762669 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=100 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:00.017415 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7f31f820-0661-481a-ae85-08a7948a670d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:00.026259 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7f31f820-0661-481a-ae85-08a7948a670d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.287744 Jul 04 04:16:00.028847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 121/227] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:15:59 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:01.047174 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1fb6e80f-cb98-4848-b01f-877499398a4d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:01.048949 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-1fb6e80f-cb98-4848-b01f-877499398a4d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:01.057002 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1fb6e80f-cb98-4848-b01f-877499398a4d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:01.058254 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1fb6e80f-cb98-4848-b01f-877499398a4d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:01.059678 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1fb6e80f-cb98-4848-b01f-877499398a4d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:01.060279 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1fb6e80f-cb98-4848-b01f-877499398a4d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:01.244343 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-1fb6e80f-cb98-4848-b01f-877499398a4d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:01.253871 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-1fb6e80f-cb98-4848-b01f-877499398a4d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.212513 Jul 04 04:16:01.264775 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 122/228] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:01 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:02.271057 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-bd5ce1b7-04ae-47d8-94e6-9da3e9acd879 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:02.272273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-bd5ce1b7-04ae-47d8-94e6-9da3e9acd879 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:02.290125 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bd5ce1b7-04ae-47d8-94e6-9da3e9acd879 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:02.290637 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bd5ce1b7-04ae-47d8-94e6-9da3e9acd879 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:02.292694 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bd5ce1b7-04ae-47d8-94e6-9da3e9acd879 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:02.295152 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bd5ce1b7-04ae-47d8-94e6-9da3e9acd879 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:02.467214 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-bd5ce1b7-04ae-47d8-94e6-9da3e9acd879 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:02.475815 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-bd5ce1b7-04ae-47d8-94e6-9da3e9acd879 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.208718 Jul 04 04:16:02.476400 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 123/229] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:02 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:03.480660 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0d75083f-9ba2-4f7d-bca7-a1170654e1b3 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "POST /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.044740 Jul 04 04:16:03.481950 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 107/230] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jul 4 04:15:58 2022] POST /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027/os-volume_attachments => generated 194 bytes in 5048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:16:03.493854 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b855f06a-99e9-467d-b15b-8e030728b25c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:03.494486 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b855f06a-99e9-467d-b15b-8e030728b25c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:03.502696 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b855f06a-99e9-467d-b15b-8e030728b25c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:03.503150 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b855f06a-99e9-467d-b15b-8e030728b25c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:03.503932 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b855f06a-99e9-467d-b15b-8e030728b25c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:03.504368 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b855f06a-99e9-467d-b15b-8e030728b25c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:03.774295 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b855f06a-99e9-467d-b15b-8e030728b25c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:03.783206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b855f06a-99e9-467d-b15b-8e030728b25c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.293064 Jul 04 04:16:03.784445 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 124/231] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:03 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:04.807953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7e363426-73cb-4365-9999-a8d966f02a9a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:04.808752 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7e363426-73cb-4365-9999-a8d966f02a9a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:04.839929 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=66 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:04.843186 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e363426-73cb-4365-9999-a8d966f02a9a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:04.844013 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e363426-73cb-4365-9999-a8d966f02a9a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:04.845964 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e363426-73cb-4365-9999-a8d966f02a9a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:04.846646 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e363426-73cb-4365-9999-a8d966f02a9a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:05.152934 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7e363426-73cb-4365-9999-a8d966f02a9a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:05.165898 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7e363426-73cb-4365-9999-a8d966f02a9a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.369090 Jul 04 04:16:05.166791 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 108/232] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:04 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:06.183432 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5e1abb52-7a8a-4f50-807f-17161ccd00ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:06.184050 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5e1abb52-7a8a-4f50-807f-17161ccd00ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:06.194894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5e1abb52-7a8a-4f50-807f-17161ccd00ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:06.196370 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5e1abb52-7a8a-4f50-807f-17161ccd00ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:06.200899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5e1abb52-7a8a-4f50-807f-17161ccd00ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:06.202123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5e1abb52-7a8a-4f50-807f-17161ccd00ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:06.898611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5e1abb52-7a8a-4f50-807f-17161ccd00ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:06.913167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5e1abb52-7a8a-4f50-807f-17161ccd00ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.732516 Jul 04 04:16:06.914525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 125/233] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:06 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:07.931446 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-31a0f540-5461-4d3f-8113-7bf7081b55c1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:07.933769 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-31a0f540-5461-4d3f-8113-7bf7081b55c1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:07.948306 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-31a0f540-5461-4d3f-8113-7bf7081b55c1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:07.949898 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-31a0f540-5461-4d3f-8113-7bf7081b55c1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:07.950969 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-31a0f540-5461-4d3f-8113-7bf7081b55c1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:07.951705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-31a0f540-5461-4d3f-8113-7bf7081b55c1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:08.188202 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-31a0f540-5461-4d3f-8113-7bf7081b55c1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:08.200513 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-31a0f540-5461-4d3f-8113-7bf7081b55c1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.273439 Jul 04 04:16:08.201626 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 109/234] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:07 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:09.217610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d6693d71-45ec-4ba1-b13f-d690989426a4 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:09.218967 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d6693d71-45ec-4ba1-b13f-d690989426a4 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:09.226027 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d6693d71-45ec-4ba1-b13f-d690989426a4 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:09.226496 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d6693d71-45ec-4ba1-b13f-d690989426a4 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:09.227436 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d6693d71-45ec-4ba1-b13f-d690989426a4 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:09.228132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d6693d71-45ec-4ba1-b13f-d690989426a4 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:09.396331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d6693d71-45ec-4ba1-b13f-d690989426a4 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:09.405777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d6693d71-45ec-4ba1-b13f-d690989426a4 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.192047 Jul 04 04:16:09.406542 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 126/235] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:09 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:10.426341 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-295139db-5ace-4024-9c73-4d9f8bee1975 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:10.427382 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-295139db-5ace-4024-9c73-4d9f8bee1975 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:10.440183 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-295139db-5ace-4024-9c73-4d9f8bee1975 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:10.441002 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-295139db-5ace-4024-9c73-4d9f8bee1975 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:10.442251 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-295139db-5ace-4024-9c73-4d9f8bee1975 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:10.442887 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-295139db-5ace-4024-9c73-4d9f8bee1975 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:10.654764 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-295139db-5ace-4024-9c73-4d9f8bee1975 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:10.667564 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-295139db-5ace-4024-9c73-4d9f8bee1975 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.247244 Jul 04 04:16:10.670759 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 110/236] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:10 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:11.694937 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-96830f66-3a48-443a-af1d-def99068a019 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:11.695568 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-96830f66-3a48-443a-af1d-def99068a019 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:11.697666 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=56 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:11.705392 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-96830f66-3a48-443a-af1d-def99068a019 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:11.705842 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-96830f66-3a48-443a-af1d-def99068a019 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:11.706845 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-96830f66-3a48-443a-af1d-def99068a019 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:11.708651 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-96830f66-3a48-443a-af1d-def99068a019 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:12.076565 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-96830f66-3a48-443a-af1d-def99068a019 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:12.087788 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-96830f66-3a48-443a-af1d-def99068a019 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.397936 Jul 04 04:16:12.097252 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 127/237] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:11 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:13.105233 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0348e2d5-7275-4921-be60-04e633fe3ed3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:13.106441 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0348e2d5-7275-4921-be60-04e633fe3ed3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:13.121017 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0348e2d5-7275-4921-be60-04e633fe3ed3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:13.124641 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0348e2d5-7275-4921-be60-04e633fe3ed3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:13.131855 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0348e2d5-7275-4921-be60-04e633fe3ed3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:13.132357 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0348e2d5-7275-4921-be60-04e633fe3ed3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:13.483739 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0348e2d5-7275-4921-be60-04e633fe3ed3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:13.493007 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0348e2d5-7275-4921-be60-04e633fe3ed3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.391734 Jul 04 04:16:13.508120 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 111/238] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:13 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:14.514157 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-fe878b88-796b-4917-8afa-baf96afba5cb tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:14.514800 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-fe878b88-796b-4917-8afa-baf96afba5cb tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:14.538105 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fe878b88-796b-4917-8afa-baf96afba5cb tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:14.538652 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fe878b88-796b-4917-8afa-baf96afba5cb tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:14.539419 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fe878b88-796b-4917-8afa-baf96afba5cb tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:14.539852 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fe878b88-796b-4917-8afa-baf96afba5cb tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:15.275206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-fe878b88-796b-4917-8afa-baf96afba5cb tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:15.295444 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-fe878b88-796b-4917-8afa-baf96afba5cb tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.786225 Jul 04 04:16:15.296035 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 128/239] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:14 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:16.319191 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5f0b7cee-f4ff-4594-bdf0-fef3f1dfc851 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:16.320096 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5f0b7cee-f4ff-4594-bdf0-fef3f1dfc851 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:16.337706 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f0b7cee-f4ff-4594-bdf0-fef3f1dfc851 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:16.341894 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f0b7cee-f4ff-4594-bdf0-fef3f1dfc851 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:16.342963 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f0b7cee-f4ff-4594-bdf0-fef3f1dfc851 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:16.343566 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5f0b7cee-f4ff-4594-bdf0-fef3f1dfc851 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:16.610151 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5f0b7cee-f4ff-4594-bdf0-fef3f1dfc851 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:16.620638 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5f0b7cee-f4ff-4594-bdf0-fef3f1dfc851 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.308111 Jul 04 04:16:16.631947 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 112/240] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:16 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:17.638292 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-cc02b742-8a4b-494e-b2a5-6f52f83ac383 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:17.639862 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-cc02b742-8a4b-494e-b2a5-6f52f83ac383 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:17.646174 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cc02b742-8a4b-494e-b2a5-6f52f83ac383 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:17.651344 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cc02b742-8a4b-494e-b2a5-6f52f83ac383 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:17.654943 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cc02b742-8a4b-494e-b2a5-6f52f83ac383 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:17.655394 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cc02b742-8a4b-494e-b2a5-6f52f83ac383 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:17.845051 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-cc02b742-8a4b-494e-b2a5-6f52f83ac383 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:17.855973 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-cc02b742-8a4b-494e-b2a5-6f52f83ac383 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.221542 Jul 04 04:16:17.857264 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 129/241] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:17 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:18.872932 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-08047ab2-f311-4e67-8bdd-550a418233a6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:18.873544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-08047ab2-f311-4e67-8bdd-550a418233a6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:18.885463 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08047ab2-f311-4e67-8bdd-550a418233a6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:18.885913 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08047ab2-f311-4e67-8bdd-550a418233a6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:18.886737 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08047ab2-f311-4e67-8bdd-550a418233a6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:18.887174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08047ab2-f311-4e67-8bdd-550a418233a6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:19.113684 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-08047ab2-f311-4e67-8bdd-550a418233a6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:19.123964 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-08047ab2-f311-4e67-8bdd-550a418233a6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.254776 Jul 04 04:16:19.125082 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 113/242] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:18 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:20.141896 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-015f6518-6886-4f4d-8030-43044ec3ed6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:20.142580 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-015f6518-6886-4f4d-8030-43044ec3ed6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:20.148710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-015f6518-6886-4f4d-8030-43044ec3ed6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:20.149153 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-015f6518-6886-4f4d-8030-43044ec3ed6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:20.149922 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-015f6518-6886-4f4d-8030-43044ec3ed6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:20.150351 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-015f6518-6886-4f4d-8030-43044ec3ed6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:20.301338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-015f6518-6886-4f4d-8030-43044ec3ed6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:20.311342 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-015f6518-6886-4f4d-8030-43044ec3ed6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.174017 Jul 04 04:16:20.312465 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 130/243] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:20 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:21.328798 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-702486b3-9a06-4fd8-93a8-1b005ab84c4b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:21.330514 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-702486b3-9a06-4fd8-93a8-1b005ab84c4b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:21.337626 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-702486b3-9a06-4fd8-93a8-1b005ab84c4b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:21.338070 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-702486b3-9a06-4fd8-93a8-1b005ab84c4b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:21.338867 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-702486b3-9a06-4fd8-93a8-1b005ab84c4b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:21.339787 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-702486b3-9a06-4fd8-93a8-1b005ab84c4b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:21.502393 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-702486b3-9a06-4fd8-93a8-1b005ab84c4b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:21.513684 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-702486b3-9a06-4fd8-93a8-1b005ab84c4b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1523 microversion: 2.1 time: 0.188790 Jul 04 04:16:21.522640 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-700dbacf-df0e-445e-92c1-73645e9e899a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1571755599", "imageRef": "46b9937d-f997-401a-a3aa-bb9028764454", "flavorRef": "452"}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:16:21.526320 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 114/244] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:21 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:21.580318 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.network.neutron [None req-700dbacf-df0e-445e-92c1-73645e9e899a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] validate_networks() for None {{(pid=117875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:16:21.896590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-700dbacf-df0e-445e-92c1-73645e9e899a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Flavor limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:16:21.897012 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-700dbacf-df0e-445e-92c1-73645e9e899a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Image limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:16:21.897501 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-700dbacf-df0e-445e-92c1-73645e9e899a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Flavor pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:16:21.897884 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-700dbacf-df0e-445e-92c1-73645e9e899a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Image pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:16:21.898289 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-700dbacf-df0e-445e-92c1-73645e9e899a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:16:21.914620 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-700dbacf-df0e-445e-92c1-73645e9e899a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:21.915430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-700dbacf-df0e-445e-92c1-73645e9e899a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:21.916342 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-700dbacf-df0e-445e-92c1-73645e9e899a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:21.916847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-700dbacf-df0e-445e-92c1-73645e9e899a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:21.936114 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-700dbacf-df0e-445e-92c1-73645e9e899a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Getting quotas for project 0a8e115afb334317ba51e73582c1f2e3. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:16:21.940333 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-700dbacf-df0e-445e-92c1-73645e9e899a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Getting quotas for user ce36bd6c2eb546249ed1c89130e5a04e and project 0a8e115afb334317ba51e73582c1f2e3. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:16:21.954349 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-700dbacf-df0e-445e-92c1-73645e9e899a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Going to run 1 instances... {{(pid=117875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:16:21.956663 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-700dbacf-df0e-445e-92c1-73645e9e899a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46b9937d-f997-401a-a3aa-bb9028764454',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:16:22.007446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-700dbacf-df0e-445e-92c1-73645e9e899a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.488855 Jul 04 04:16:22.013114 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 131/245] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:16:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 04:16:22.018801 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4a7d2b5e-15f7-4f9f-826b-20e027152a7a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:22.019408 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4a7d2b5e-15f7-4f9f-826b-20e027152a7a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:22.171249 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4a7d2b5e-15f7-4f9f-826b-20e027152a7a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:22.181272 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4a7d2b5e-15f7-4f9f-826b-20e027152a7a tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1215 microversion: 2.1 time: 0.165585 Jul 04 04:16:22.181929 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 115/246] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:22 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1215 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:22.535117 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a3ab47eb-585c-4eda-ab00-712b2334de6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:22.536065 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a3ab47eb-585c-4eda-ab00-712b2334de6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:22.545963 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a3ab47eb-585c-4eda-ab00-712b2334de6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:22.547296 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a3ab47eb-585c-4eda-ab00-712b2334de6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:22.550517 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a3ab47eb-585c-4eda-ab00-712b2334de6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:22.551253 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a3ab47eb-585c-4eda-ab00-712b2334de6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:22.720024 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a3ab47eb-585c-4eda-ab00-712b2334de6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:22.730680 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a3ab47eb-585c-4eda-ab00-712b2334de6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1503 microversion: 2.1 time: 0.202421 Jul 04 04:16:22.732813 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 132/247] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:22 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1503 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:22.751005 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0fefbe33-7fda-4f9d-847b-d64d6f14d537 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:22.753106 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0fefbe33-7fda-4f9d-847b-d64d6f14d537 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:22.762181 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fefbe33-7fda-4f9d-847b-d64d6f14d537 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:22.762854 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fefbe33-7fda-4f9d-847b-d64d6f14d537 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:22.764714 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fefbe33-7fda-4f9d-847b-d64d6f14d537 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:22.765228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fefbe33-7fda-4f9d-847b-d64d6f14d537 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:22.975633 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0fefbe33-7fda-4f9d-847b-d64d6f14d537 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:22.987347 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0fefbe33-7fda-4f9d-847b-d64d6f14d537 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1515 microversion: 2.1 time: 0.242094 Jul 04 04:16:22.988532 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 116/248] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:22 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1515 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:23.202564 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b9115312-497f-4bca-9830-026d81931dd0 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:23.204001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b9115312-497f-4bca-9830-026d81931dd0 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:23.219474 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b9115312-497f-4bca-9830-026d81931dd0 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:23.219930 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b9115312-497f-4bca-9830-026d81931dd0 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:23.220711 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b9115312-497f-4bca-9830-026d81931dd0 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:23.221154 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b9115312-497f-4bca-9830-026d81931dd0 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:23.309297 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-16e27bd8-cc32-4f17-8cae-fe6e4bdf736b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Action: 'create', calling method: .version_select at 0x7f50c1adbd30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-67529793", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtQ+fdi5u/PhA7v7i75dtL5Is1ub6bvSVipaoVlHRw4trFOrd6N18yJc10hp4CA1wWHw2uD2G5uIQrIkwfODLMaKXvN6nQpSPiW8WrNV2Y72Wx0FmoqUMo0INcM5LQKtg=="}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:16:23.337846 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b9115312-497f-4bca-9830-026d81931dd0 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:23.342790 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-16e27bd8-cc32-4f17-8cae-fe6e4bdf736b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Getting quotas for project c487ee37e54042d680eccb72b046bb55. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:16:23.346708 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b9115312-497f-4bca-9830-026d81931dd0 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1211 microversion: 2.1 time: 0.151414 Jul 04 04:16:23.347657 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 133/249] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:23 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1211 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:23.351985 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-16e27bd8-cc32-4f17-8cae-fe6e4bdf736b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Getting quotas for user 031fb205335f407bb2d275476b98fe24 and project c487ee37e54042d680eccb72b046bb55. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:16:23.401132 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-16e27bd8-cc32-4f17-8cae-fe6e4bdf736b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.096323 Jul 04 04:16:23.402265 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 117/250] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jul 4 04:16:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:16:23.532817 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a1830ac9-6e63-423b-8a6b-42da553bc22d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-449836106", "imageRef": "dc6a815e-2180-45ae-b183-fdda162e83b9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-67529793", "networks": [{"uuid": "3beef653-ae8d-4ba3-962e-487bd0dbfb0c"}]}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:16:23.582759 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.network.neutron [None req-a1830ac9-6e63-423b-8a6b-42da553bc22d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] validate_networks() for [('3beef653-ae8d-4ba3-962e-487bd0dbfb0c', None, None, None, None, None)] {{(pid=117875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:16:24.167675 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-a1830ac9-6e63-423b-8a6b-42da553bc22d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Flavor limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:16:24.168265 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-a1830ac9-6e63-423b-8a6b-42da553bc22d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Image limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:16:24.168958 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-a1830ac9-6e63-423b-8a6b-42da553bc22d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Flavor pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:16:24.169557 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-a1830ac9-6e63-423b-8a6b-42da553bc22d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Image pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:16:24.170051 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-a1830ac9-6e63-423b-8a6b-42da553bc22d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:16:24.180658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a1830ac9-6e63-423b-8a6b-42da553bc22d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:24.181101 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a1830ac9-6e63-423b-8a6b-42da553bc22d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:24.181879 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a1830ac9-6e63-423b-8a6b-42da553bc22d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:24.182302 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a1830ac9-6e63-423b-8a6b-42da553bc22d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:24.199669 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-a1830ac9-6e63-423b-8a6b-42da553bc22d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Getting quotas for project c487ee37e54042d680eccb72b046bb55. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:16:24.203990 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-a1830ac9-6e63-423b-8a6b-42da553bc22d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Getting quotas for user 031fb205335f407bb2d275476b98fe24 and project c487ee37e54042d680eccb72b046bb55. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:16:24.215187 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a1830ac9-6e63-423b-8a6b-42da553bc22d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Going to run 1 instances... {{(pid=117875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:16:24.217228 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a1830ac9-6e63-423b-8a6b-42da553bc22d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dc6a815e-2180-45ae-b183-fdda162e83b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:16:24.269124 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a1830ac9-6e63-423b-8a6b-42da553bc22d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740304 Jul 04 04:16:24.269937 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 134/251] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:16:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 04:16:24.279986 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1f95acee-eec1-48d1-b222-e89acf5962e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:24.280612 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1f95acee-eec1-48d1-b222-e89acf5962e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:24.342271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1f95acee-eec1-48d1-b222-e89acf5962e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:24.351101 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1f95acee-eec1-48d1-b222-e89acf5962e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1256 microversion: 2.1 time: 0.075165 Jul 04 04:16:24.351842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 118/252] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:24 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1256 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:24.363553 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1edb2a52-5e5d-407b-85eb-044d763cb9aa tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:24.364370 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-1edb2a52-5e5d-407b-85eb-044d763cb9aa tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:24.372466 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1edb2a52-5e5d-407b-85eb-044d763cb9aa tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:24.372798 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1edb2a52-5e5d-407b-85eb-044d763cb9aa tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:24.374787 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1edb2a52-5e5d-407b-85eb-044d763cb9aa tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:24.375667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1edb2a52-5e5d-407b-85eb-044d763cb9aa tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:24.439755 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-1edb2a52-5e5d-407b-85eb-044d763cb9aa tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:24.447774 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-1edb2a52-5e5d-407b-85eb-044d763cb9aa tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1211 microversion: 2.1 time: 0.087951 Jul 04 04:16:24.457336 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 135/253] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:24 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:25.373341 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4bf5119c-831d-4920-8072-5e6c75a5efb2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:25.374267 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4bf5119c-831d-4920-8072-5e6c75a5efb2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:25.382545 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bf5119c-831d-4920-8072-5e6c75a5efb2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:25.382995 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bf5119c-831d-4920-8072-5e6c75a5efb2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:25.383761 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bf5119c-831d-4920-8072-5e6c75a5efb2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:25.384171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bf5119c-831d-4920-8072-5e6c75a5efb2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:25.452716 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4bf5119c-831d-4920-8072-5e6c75a5efb2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:25.460262 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4bf5119c-831d-4920-8072-5e6c75a5efb2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1260 microversion: 2.1 time: 0.093361 Jul 04 04:16:25.460843 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 119/254] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:25 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1260 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:25.465078 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-22e690cf-9590-4b8f-a2e9-a6f860df4c29 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:25.465750 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-22e690cf-9590-4b8f-a2e9-a6f860df4c29 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:25.472489 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-22e690cf-9590-4b8f-a2e9-a6f860df4c29 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:25.472934 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-22e690cf-9590-4b8f-a2e9-a6f860df4c29 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:25.473664 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-22e690cf-9590-4b8f-a2e9-a6f860df4c29 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:25.474149 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-22e690cf-9590-4b8f-a2e9-a6f860df4c29 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:25.537806 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-22e690cf-9590-4b8f-a2e9-a6f860df4c29 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:25.545384 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-22e690cf-9590-4b8f-a2e9-a6f860df4c29 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1211 microversion: 2.1 time: 0.084249 Jul 04 04:16:25.545938 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 136/255] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:25 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:26.478142 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7c1b15f8-51af-49f1-8861-08a213201c5f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:26.478909 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7c1b15f8-51af-49f1-8861-08a213201c5f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:26.486206 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c1b15f8-51af-49f1-8861-08a213201c5f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:26.486688 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c1b15f8-51af-49f1-8861-08a213201c5f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:26.488141 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c1b15f8-51af-49f1-8861-08a213201c5f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:26.488587 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c1b15f8-51af-49f1-8861-08a213201c5f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:26.561599 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7c1b15f8-51af-49f1-8861-08a213201c5f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:26.566957 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-24852552-efab-455e-8e00-dc674c48d23f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:26.567566 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-24852552-efab-455e-8e00-dc674c48d23f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:26.569961 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7c1b15f8-51af-49f1-8861-08a213201c5f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1260 microversion: 2.1 time: 0.096288 Jul 04 04:16:26.571335 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 120/256] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:26 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1260 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:26.574895 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-24852552-efab-455e-8e00-dc674c48d23f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:26.575342 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-24852552-efab-455e-8e00-dc674c48d23f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:26.576135 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-24852552-efab-455e-8e00-dc674c48d23f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:26.576558 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-24852552-efab-455e-8e00-dc674c48d23f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:26.648912 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-24852552-efab-455e-8e00-dc674c48d23f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:26.657045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-24852552-efab-455e-8e00-dc674c48d23f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1211 microversion: 2.1 time: 0.097368 Jul 04 04:16:26.657683 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 137/257] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:26 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:27.212387 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-264d7508-0096-417e-8de3-898214e73665 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:27.212875 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-264d7508-0096-417e-8de3-898214e73665 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:27.219353 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-264d7508-0096-417e-8de3-898214e73665 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:27.219980 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-264d7508-0096-417e-8de3-898214e73665 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:27.220751 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-264d7508-0096-417e-8de3-898214e73665 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:27.221176 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-264d7508-0096-417e-8de3-898214e73665 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:27.223809 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:27.247883 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-264d7508-0096-417e-8de3-898214e73665 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:16:27.351796 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-264d7508-0096-417e-8de3-898214e73665 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 204 len: 0 microversion: 2.1 time: 0.142805 Jul 04 04:16:27.352330 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 121/258] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:16:27 2022] DELETE /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:16:27.361814 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ccf0c760-6e40-44cf-95f4-a3d712412d2c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:27.362550 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-ccf0c760-6e40-44cf-95f4-a3d712412d2c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:27.370330 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ccf0c760-6e40-44cf-95f4-a3d712412d2c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:27.371623 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ccf0c760-6e40-44cf-95f4-a3d712412d2c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:27.372448 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ccf0c760-6e40-44cf-95f4-a3d712412d2c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:27.372925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ccf0c760-6e40-44cf-95f4-a3d712412d2c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:27.513164 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-ccf0c760-6e40-44cf-95f4-a3d712412d2c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:27.522641 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ccf0c760-6e40-44cf-95f4-a3d712412d2c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1553 microversion: 2.1 time: 0.165213 Jul 04 04:16:27.523400 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 138/259] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:27 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:27.586936 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d2ad8818-6a51-40ed-871f-6fcd568d93ac tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:27.587631 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d2ad8818-6a51-40ed-871f-6fcd568d93ac tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:27.594162 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2ad8818-6a51-40ed-871f-6fcd568d93ac tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:27.594678 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2ad8818-6a51-40ed-871f-6fcd568d93ac tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:27.595442 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2ad8818-6a51-40ed-871f-6fcd568d93ac tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:27.595859 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2ad8818-6a51-40ed-871f-6fcd568d93ac tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:27.670521 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d2ad8818-6a51-40ed-871f-6fcd568d93ac tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:27.673594 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-91caa837-bc00-487e-a0ca-13e6453013d3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:27.674585 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-91caa837-bc00-487e-a0ca-13e6453013d3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:27.682104 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d2ad8818-6a51-40ed-871f-6fcd568d93ac tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1308 microversion: 2.1 time: 0.099497 Jul 04 04:16:27.682802 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 122/260] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:27 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:27.690566 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-91caa837-bc00-487e-a0ca-13e6453013d3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:27.691011 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-91caa837-bc00-487e-a0ca-13e6453013d3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:27.691820 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-91caa837-bc00-487e-a0ca-13e6453013d3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:27.692256 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-91caa837-bc00-487e-a0ca-13e6453013d3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:27.696540 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=100 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:27.755792 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-91caa837-bc00-487e-a0ca-13e6453013d3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:27.764377 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-91caa837-bc00-487e-a0ca-13e6453013d3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1285 microversion: 2.1 time: 0.094941 Jul 04 04:16:27.764927 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 139/261] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:27 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:28.539749 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1970990f-c970-4abe-888b-2a7b8a2539d2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:28.540356 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1970990f-c970-4abe-888b-2a7b8a2539d2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:28.546745 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1970990f-c970-4abe-888b-2a7b8a2539d2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:28.547193 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1970990f-c970-4abe-888b-2a7b8a2539d2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:28.547962 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1970990f-c970-4abe-888b-2a7b8a2539d2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:28.548416 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1970990f-c970-4abe-888b-2a7b8a2539d2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:28.685688 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1970990f-c970-4abe-888b-2a7b8a2539d2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:28.696997 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1970990f-c970-4abe-888b-2a7b8a2539d2 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1553 microversion: 2.1 time: 0.161000 Jul 04 04:16:28.698039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 123/262] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:28 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:28.709055 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e5dab675-7fc3-4df8-846f-f7b3e34d4cdf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:28.709662 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e5dab675-7fc3-4df8-846f-f7b3e34d4cdf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:28.717504 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e5dab675-7fc3-4df8-846f-f7b3e34d4cdf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:28.717950 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e5dab675-7fc3-4df8-846f-f7b3e34d4cdf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:28.718807 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e5dab675-7fc3-4df8-846f-f7b3e34d4cdf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:28.719549 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e5dab675-7fc3-4df8-846f-f7b3e34d4cdf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:28.757989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-83865c8e-1add-4669-9636-8eef60de030b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:16:28.763236 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-83865c8e-1add-4669-9636-8eef60de030b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:28.778636 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83865c8e-1add-4669-9636-8eef60de030b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:28.779309 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83865c8e-1add-4669-9636-8eef60de030b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:28.780604 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83865c8e-1add-4669-9636-8eef60de030b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:28.781188 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83865c8e-1add-4669-9636-8eef60de030b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:28.824181 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-83865c8e-1add-4669-9636-8eef60de030b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lazy-loading 'flavor' on Instance uuid 6e519dd6-a044-4afa-ac1b-bf1f53611738 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:16:28.853872 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e5dab675-7fc3-4df8-846f-f7b3e34d4cdf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:28.870523 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e5dab675-7fc3-4df8-846f-f7b3e34d4cdf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1308 microversion: 2.1 time: 0.174653 Jul 04 04:16:28.871579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 140/263] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:28 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:28.892664 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-bbc80bb0-18c5-4c23-a7c4-5e8cf177161c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:28.896882 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-bbc80bb0-18c5-4c23-a7c4-5e8cf177161c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:28.903441 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bbc80bb0-18c5-4c23-a7c4-5e8cf177161c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:28.904062 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bbc80bb0-18c5-4c23-a7c4-5e8cf177161c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:28.904988 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bbc80bb0-18c5-4c23-a7c4-5e8cf177161c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:28.905556 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bbc80bb0-18c5-4c23-a7c4-5e8cf177161c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:28.951095 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-83865c8e-1add-4669-9636-8eef60de030b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "POST /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738/action" status: 200 len: 32 microversion: 2.1 time: 0.197924 Jul 04 04:16:28.952083 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 124/264] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 4 04:16:28 2022] POST /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 04:16:28.967532 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7b730d06-7526-490c-9d3b-d1aa45f92421 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:28.968237 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7b730d06-7526-490c-9d3b-d1aa45f92421 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:28.981494 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-bbc80bb0-18c5-4c23-a7c4-5e8cf177161c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:28.982517 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b730d06-7526-490c-9d3b-d1aa45f92421 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:28.982981 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b730d06-7526-490c-9d3b-d1aa45f92421 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:28.983749 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b730d06-7526-490c-9d3b-d1aa45f92421 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:28.984348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b730d06-7526-490c-9d3b-d1aa45f92421 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:29.004302 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-bbc80bb0-18c5-4c23-a7c4-5e8cf177161c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1273 microversion: 2.1 time: 0.130885 Jul 04 04:16:29.014416 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 141/265] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:28 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1273 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:29.154985 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7b730d06-7526-490c-9d3b-d1aa45f92421 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:29.164275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7b730d06-7526-490c-9d3b-d1aa45f92421 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.206639 Jul 04 04:16:29.165142 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 125/266] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:28 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:29.714839 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-20452467-05df-4464-bcd5-3d7866cf9673 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:29.715591 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-20452467-05df-4464-bcd5-3d7866cf9673 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:29.721907 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-20452467-05df-4464-bcd5-3d7866cf9673 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:29.722490 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-20452467-05df-4464-bcd5-3d7866cf9673 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:29.723337 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-20452467-05df-4464-bcd5-3d7866cf9673 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:29.724443 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-20452467-05df-4464-bcd5-3d7866cf9673 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:29.888599 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-39f660b0-18ba-48e4-a5ca-d2f2b30b9827 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:29.889546 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-39f660b0-18ba-48e4-a5ca-d2f2b30b9827 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:29.904561 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39f660b0-18ba-48e4-a5ca-d2f2b30b9827 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:29.905103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39f660b0-18ba-48e4-a5ca-d2f2b30b9827 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:29.907475 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39f660b0-18ba-48e4-a5ca-d2f2b30b9827 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:29.908346 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39f660b0-18ba-48e4-a5ca-d2f2b30b9827 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:29.915944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-20452467-05df-4464-bcd5-3d7866cf9673 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:29.925301 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-20452467-05df-4464-bcd5-3d7866cf9673 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1553 microversion: 2.1 time: 0.214450 Jul 04 04:16:29.925954 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 142/267] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:29 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1553 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:30.022431 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b584ca57-c98d-4a9b-954f-026f84757fed tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:30.023136 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b584ca57-c98d-4a9b-954f-026f84757fed tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:30.030169 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b584ca57-c98d-4a9b-954f-026f84757fed tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:30.030779 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b584ca57-c98d-4a9b-954f-026f84757fed tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:30.031765 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b584ca57-c98d-4a9b-954f-026f84757fed tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:30.032193 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b584ca57-c98d-4a9b-954f-026f84757fed tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:30.080029 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-39f660b0-18ba-48e4-a5ca-d2f2b30b9827 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:30.088397 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-39f660b0-18ba-48e4-a5ca-d2f2b30b9827 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1326 microversion: 2.1 time: 0.204806 Jul 04 04:16:30.089632 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 126/268] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:29 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1326 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:30.195032 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bf7575c0-fec6-4190-b60f-70d9622354d8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:30.196762 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bf7575c0-fec6-4190-b60f-70d9622354d8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:30.199678 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b584ca57-c98d-4a9b-954f-026f84757fed tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:30.211097 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf7575c0-fec6-4190-b60f-70d9622354d8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:30.211739 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf7575c0-fec6-4190-b60f-70d9622354d8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:30.212694 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf7575c0-fec6-4190-b60f-70d9622354d8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:30.213127 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf7575c0-fec6-4190-b60f-70d9622354d8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:30.237951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b584ca57-c98d-4a9b-954f-026f84757fed tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1273 microversion: 2.1 time: 0.217705 Jul 04 04:16:30.240070 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 143/269] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:30 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:30.740205 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bf7575c0-fec6-4190-b60f-70d9622354d8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:30.748320 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bf7575c0-fec6-4190-b60f-70d9622354d8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.568840 Jul 04 04:16:30.748993 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 127/270] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:30 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:30.943547 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a28249ad-3aa4-4855-b336-7e66d7ec8a5f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:30.945032 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a28249ad-3aa4-4855-b336-7e66d7ec8a5f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:30.964027 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a28249ad-3aa4-4855-b336-7e66d7ec8a5f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:30.964766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a28249ad-3aa4-4855-b336-7e66d7ec8a5f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:30.965694 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a28249ad-3aa4-4855-b336-7e66d7ec8a5f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:30.966269 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a28249ad-3aa4-4855-b336-7e66d7ec8a5f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:31.107062 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2ae62c71-8407-472c-92a4-4ef15acf21e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:31.108505 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2ae62c71-8407-472c-92a4-4ef15acf21e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:31.135938 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ae62c71-8407-472c-92a4-4ef15acf21e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:31.137024 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ae62c71-8407-472c-92a4-4ef15acf21e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:31.144381 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ae62c71-8407-472c-92a4-4ef15acf21e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:31.145156 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ae62c71-8407-472c-92a4-4ef15acf21e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:31.371542 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a28249ad-3aa4-4855-b336-7e66d7ec8a5f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:31.389336 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a28249ad-3aa4-4855-b336-7e66d7ec8a5f tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1511 microversion: 2.1 time: 0.449955 Jul 04 04:16:31.390244 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 144/271] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:30 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1511 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:31.416959 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-6c77def8-2de3-4a0d-9fc9-2e5560ef05d5 req-8f487740-42dc-4ebe-a233-5d7f6a1ba8ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbd2b17-e16f-4867-87bd-9e0430d8b027", "name": "network-vif-deleted", "tag": "44387a5e-08a3-462a-be05-f2befd8e7016"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:16:31.443350 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-6c77def8-2de3-4a0d-9fc9-2e5560ef05d5 req-8f487740-42dc-4ebe-a233-5d7f6a1ba8ae service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:31.444085 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-6c77def8-2de3-4a0d-9fc9-2e5560ef05d5 req-8f487740-42dc-4ebe-a233-5d7f6a1ba8ae service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:31.463134 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-6c77def8-2de3-4a0d-9fc9-2e5560ef05d5 req-8f487740-42dc-4ebe-a233-5d7f6a1ba8ae service nova] Creating event network-vif-deleted:44387a5e-08a3-462a-be05-f2befd8e7016 for instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 on hv-cinder-74216 Jul 04 04:16:31.500489 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-6c77def8-2de3-4a0d-9fc9-2e5560ef05d5 req-8f487740-42dc-4ebe-a233-5d7f6a1ba8ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096386 Jul 04 04:16:31.503649 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 145/272] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:16:31.509980 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b5115365-b7f5-4e13-be76-02719a9df419 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:31.527777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b5115365-b7f5-4e13-be76-02719a9df419 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:31.558799 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b5115365-b7f5-4e13-be76-02719a9df419 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:31.559194 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b5115365-b7f5-4e13-be76-02719a9df419 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:31.559980 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b5115365-b7f5-4e13-be76-02719a9df419 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:31.560412 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b5115365-b7f5-4e13-be76-02719a9df419 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:31.749879 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2ae62c71-8407-472c-92a4-4ef15acf21e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:31.763564 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2ae62c71-8407-472c-92a4-4ef15acf21e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1314 microversion: 2.1 time: 0.660787 Jul 04 04:16:31.770206 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 128/273] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:31 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1314 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:31.775367 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4657722b-5d2b-451b-a4b3-b21341238d41 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:31.783594 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4657722b-5d2b-451b-a4b3-b21341238d41 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:31.792235 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4657722b-5d2b-451b-a4b3-b21341238d41 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:31.799216 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4657722b-5d2b-451b-a4b3-b21341238d41 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:31.800735 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4657722b-5d2b-451b-a4b3-b21341238d41 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:31.801325 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4657722b-5d2b-451b-a4b3-b21341238d41 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:31.920122 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b5115365-b7f5-4e13-be76-02719a9df419 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:31.946600 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b5115365-b7f5-4e13-be76-02719a9df419 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.430201 Jul 04 04:16:31.947259 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 146/274] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:31 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:32.415126 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c88e2eb4-d87d-4ea4-a1cf-e4c83212191b tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:32.416400 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c88e2eb4-d87d-4ea4-a1cf-e4c83212191b tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:32.426166 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c88e2eb4-d87d-4ea4-a1cf-e4c83212191b tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:32.426942 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c88e2eb4-d87d-4ea4-a1cf-e4c83212191b tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:32.429346 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c88e2eb4-d87d-4ea4-a1cf-e4c83212191b tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:32.429995 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c88e2eb4-d87d-4ea4-a1cf-e4c83212191b tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:32.546151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c88e2eb4-d87d-4ea4-a1cf-e4c83212191b tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:32.568724 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c88e2eb4-d87d-4ea4-a1cf-e4c83212191b tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1346 microversion: 2.1 time: 0.162731 Jul 04 04:16:32.570990 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 147/275] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:32 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1346 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:32.782401 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a06b5b76-6292-4528-a9aa-6270d44eb726 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:32.783914 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a06b5b76-6292-4528-a9aa-6270d44eb726 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:32.797518 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a06b5b76-6292-4528-a9aa-6270d44eb726 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:32.818720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a06b5b76-6292-4528-a9aa-6270d44eb726 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:32.820604 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a06b5b76-6292-4528-a9aa-6270d44eb726 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:32.823429 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a06b5b76-6292-4528-a9aa-6270d44eb726 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:32.873075 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4657722b-5d2b-451b-a4b3-b21341238d41 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:32.885589 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4657722b-5d2b-451b-a4b3-b21341238d41 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 1.114130 Jul 04 04:16:32.897332 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 129/276] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:31 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:32.967539 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a06b5b76-6292-4528-a9aa-6270d44eb726 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:32.973639 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d10c07d8-5f87-48a0-a97f-9df8b1c0dbf5 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:32.975904 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d10c07d8-5f87-48a0-a97f-9df8b1c0dbf5 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:32.994032 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a06b5b76-6292-4528-a9aa-6270d44eb726 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1314 microversion: 2.1 time: 0.213407 Jul 04 04:16:32.997182 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 148/277] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:32 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:33.003738 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d10c07d8-5f87-48a0-a97f-9df8b1c0dbf5 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:33.004480 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d10c07d8-5f87-48a0-a97f-9df8b1c0dbf5 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:33.005449 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d10c07d8-5f87-48a0-a97f-9df8b1c0dbf5 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:33.006003 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d10c07d8-5f87-48a0-a97f-9df8b1c0dbf5 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:33.588516 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-fd976ecc-f765-46a2-a80b-9dd610161b72 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:33.589167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-fd976ecc-f765-46a2-a80b-9dd610161b72 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:33.604137 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fd976ecc-f765-46a2-a80b-9dd610161b72 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:33.604831 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fd976ecc-f765-46a2-a80b-9dd610161b72 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:33.605815 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fd976ecc-f765-46a2-a80b-9dd610161b72 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:33.606294 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fd976ecc-f765-46a2-a80b-9dd610161b72 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:33.795457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d10c07d8-5f87-48a0-a97f-9df8b1c0dbf5 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:33.803559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d10c07d8-5f87-48a0-a97f-9df8b1c0dbf5 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.843740 Jul 04 04:16:33.804142 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 130/278] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:32 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:33.809757 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-fd976ecc-f765-46a2-a80b-9dd610161b72 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:33.828517 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-fd976ecc-f765-46a2-a80b-9dd610161b72 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1346 microversion: 2.1 time: 0.239088 Jul 04 04:16:33.828517 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 149/279] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:33 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1346 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:33.905685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2a1e5a62-d63d-41d5-9643-477a08972bd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:33.912678 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2a1e5a62-d63d-41d5-9643-477a08972bd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:33.917735 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a1e5a62-d63d-41d5-9643-477a08972bd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:33.918233 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a1e5a62-d63d-41d5-9643-477a08972bd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:33.919015 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a1e5a62-d63d-41d5-9643-477a08972bd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:33.919454 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a1e5a62-d63d-41d5-9643-477a08972bd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:34.012488 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d7d1d5c7-fc04-4cc9-b97a-ce77b2059853 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:34.013223 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d7d1d5c7-fc04-4cc9-b97a-ce77b2059853 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:34.023676 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d7d1d5c7-fc04-4cc9-b97a-ce77b2059853 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:34.024138 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d7d1d5c7-fc04-4cc9-b97a-ce77b2059853 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:34.024927 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d7d1d5c7-fc04-4cc9-b97a-ce77b2059853 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:34.035307 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d7d1d5c7-fc04-4cc9-b97a-ce77b2059853 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:34.194891 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=4 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:34.210866 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=12 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:34.214852 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2a1e5a62-d63d-41d5-9643-477a08972bd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:34.228340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2a1e5a62-d63d-41d5-9643-477a08972bd0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.325614 Jul 04 04:16:34.230543 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 131/280] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:33 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:34.293137 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d7d1d5c7-fc04-4cc9-b97a-ce77b2059853 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:34.304878 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d7d1d5c7-fc04-4cc9-b97a-ce77b2059853 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.296028 Jul 04 04:16:34.307140 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 150/281] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:34 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:34.322586 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-a6e6916c-2f3e-46a6-963a-312c1c3774fd req-37cb78c0-b7dd-4354-b8ac-96a8bac88189 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db1e5292-d768-4e52-b4e1-91ef1e02e688", "tag": "bb2c5801-9617-4283-b348-91c2765ed7fd"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:16:34.332562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-a6e6916c-2f3e-46a6-963a-312c1c3774fd req-37cb78c0-b7dd-4354-b8ac-96a8bac88189 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:34.333279 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-a6e6916c-2f3e-46a6-963a-312c1c3774fd req-37cb78c0-b7dd-4354-b8ac-96a8bac88189 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:34.350769 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=8 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:34.355144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-a6e6916c-2f3e-46a6-963a-312c1c3774fd req-37cb78c0-b7dd-4354-b8ac-96a8bac88189 service nova] Creating event network-changed:bb2c5801-9617-4283-b348-91c2765ed7fd for instance db1e5292-d768-4e52-b4e1-91ef1e02e688 on hv-cinder-74216 Jul 04 04:16:34.360737 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-a6e6916c-2f3e-46a6-963a-312c1c3774fd req-37cb78c0-b7dd-4354-b8ac-96a8bac88189 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043139 Jul 04 04:16:34.361863 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 132/282] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:16:34.820541 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-77ead22b-270d-40a4-ab40-11db232cee27 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:34.821145 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-77ead22b-270d-40a4-ab40-11db232cee27 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:34.827354 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-77ead22b-270d-40a4-ab40-11db232cee27 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:34.827798 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-77ead22b-270d-40a4-ab40-11db232cee27 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:34.828612 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-77ead22b-270d-40a4-ab40-11db232cee27 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:34.829047 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-77ead22b-270d-40a4-ab40-11db232cee27 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:34.852456 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-07e524b4-9046-4e29-aa96-76a435bb492b tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:34.853350 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-07e524b4-9046-4e29-aa96-76a435bb492b tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:34.855753 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:34.864818 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-07e524b4-9046-4e29-aa96-76a435bb492b tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:34.865271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-07e524b4-9046-4e29-aa96-76a435bb492b tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:34.866079 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-07e524b4-9046-4e29-aa96-76a435bb492b tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:34.866544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-07e524b4-9046-4e29-aa96-76a435bb492b tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:35.005523 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-07e524b4-9046-4e29-aa96-76a435bb492b tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:35.045817 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-07e524b4-9046-4e29-aa96-76a435bb492b tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1346 microversion: 2.1 time: 0.190540 Jul 04 04:16:35.046166 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 133/283] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:34 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1346 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:35.084802 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-77ead22b-270d-40a4-ab40-11db232cee27 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:35.098049 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-77ead22b-270d-40a4-ab40-11db232cee27 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.281151 Jul 04 04:16:35.099886 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 151/284] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:34 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:35.246686 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3f8dc1d7-ac92-427e-a2d5-4b4e93a79c28 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:35.247281 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3f8dc1d7-ac92-427e-a2d5-4b4e93a79c28 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:35.253752 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3f8dc1d7-ac92-427e-a2d5-4b4e93a79c28 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:35.254195 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3f8dc1d7-ac92-427e-a2d5-4b4e93a79c28 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:35.254991 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3f8dc1d7-ac92-427e-a2d5-4b4e93a79c28 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:35.255500 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3f8dc1d7-ac92-427e-a2d5-4b4e93a79c28 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:35.323144 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-632fd915-7769-4edc-9f38-6145260d8b67 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:35.323838 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-632fd915-7769-4edc-9f38-6145260d8b67 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:35.330013 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-632fd915-7769-4edc-9f38-6145260d8b67 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:35.330765 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-632fd915-7769-4edc-9f38-6145260d8b67 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:35.331713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-632fd915-7769-4edc-9f38-6145260d8b67 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:35.332153 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-632fd915-7769-4edc-9f38-6145260d8b67 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:35.405163 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3f8dc1d7-ac92-427e-a2d5-4b4e93a79c28 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:35.407834 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:35.418209 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3f8dc1d7-ac92-427e-a2d5-4b4e93a79c28 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.175266 Jul 04 04:16:35.418822 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 134/285] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:35 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:35.473766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-632fd915-7769-4edc-9f38-6145260d8b67 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:35.484134 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-632fd915-7769-4edc-9f38-6145260d8b67 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.164867 Jul 04 04:16:35.484891 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 152/286] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:35 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:36.062460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b8616df5-9b66-479d-a95b-af68e05ce960 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:36.063176 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b8616df5-9b66-479d-a95b-af68e05ce960 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:36.070112 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b8616df5-9b66-479d-a95b-af68e05ce960 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:36.070599 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b8616df5-9b66-479d-a95b-af68e05ce960 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:36.071370 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b8616df5-9b66-479d-a95b-af68e05ce960 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:36.071801 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b8616df5-9b66-479d-a95b-af68e05ce960 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:36.117074 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e7417fb7-8642-4d5e-8a5b-5e0f1b8f45f3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:36.118480 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e7417fb7-8642-4d5e-8a5b-5e0f1b8f45f3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:36.132512 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7417fb7-8642-4d5e-8a5b-5e0f1b8f45f3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:36.133237 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7417fb7-8642-4d5e-8a5b-5e0f1b8f45f3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:36.134073 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7417fb7-8642-4d5e-8a5b-5e0f1b8f45f3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:36.134620 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7417fb7-8642-4d5e-8a5b-5e0f1b8f45f3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:36.152388 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b8616df5-9b66-479d-a95b-af68e05ce960 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:36.160917 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b8616df5-9b66-479d-a95b-af68e05ce960 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1346 microversion: 2.1 time: 0.102301 Jul 04 04:16:36.163646 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 135/287] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:36 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:36.308856 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e7417fb7-8642-4d5e-8a5b-5e0f1b8f45f3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:36.317529 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e7417fb7-8642-4d5e-8a5b-5e0f1b8f45f3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.204916 Jul 04 04:16:36.318469 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 153/288] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:36 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:36.456960 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fc1dc699-1363-4427-90b8-099f48ff4f63 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:36.458706 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fc1dc699-1363-4427-90b8-099f48ff4f63 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:36.468079 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc1dc699-1363-4427-90b8-099f48ff4f63 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:36.468864 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc1dc699-1363-4427-90b8-099f48ff4f63 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:36.469563 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc1dc699-1363-4427-90b8-099f48ff4f63 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:36.469990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc1dc699-1363-4427-90b8-099f48ff4f63 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:36.502083 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9d8111bb-ea5b-4ea0-88ca-d69994a57b5d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:36.502900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-9d8111bb-ea5b-4ea0-88ca-d69994a57b5d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:36.514655 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9d8111bb-ea5b-4ea0-88ca-d69994a57b5d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:36.521191 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9d8111bb-ea5b-4ea0-88ca-d69994a57b5d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:36.522281 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9d8111bb-ea5b-4ea0-88ca-d69994a57b5d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:36.523042 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9d8111bb-ea5b-4ea0-88ca-d69994a57b5d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:36.671285 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fc1dc699-1363-4427-90b8-099f48ff4f63 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:36.682551 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fc1dc699-1363-4427-90b8-099f48ff4f63 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.234921 Jul 04 04:16:36.683501 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 136/289] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:36 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:36.723667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9d8111bb-ea5b-4ea0-88ca-d69994a57b5d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:36.735028 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9d8111bb-ea5b-4ea0-88ca-d69994a57b5d tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.237592 Jul 04 04:16:36.745621 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 154/290] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:36 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:37.181961 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7c8e6e24-5ab9-4909-aade-3c020e2dde0a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:37.182600 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7c8e6e24-5ab9-4909-aade-3c020e2dde0a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:37.189167 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c8e6e24-5ab9-4909-aade-3c020e2dde0a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:37.189869 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c8e6e24-5ab9-4909-aade-3c020e2dde0a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:37.190694 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c8e6e24-5ab9-4909-aade-3c020e2dde0a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:37.191142 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c8e6e24-5ab9-4909-aade-3c020e2dde0a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:37.259677 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7c8e6e24-5ab9-4909-aade-3c020e2dde0a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:37.269178 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7c8e6e24-5ab9-4909-aade-3c020e2dde0a tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1346 microversion: 2.1 time: 0.091608 Jul 04 04:16:37.270201 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 137/291] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:37 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:37.337377 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-bf243a3c-0c02-46d6-ad88-19487d9624b8 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:37.337981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-bf243a3c-0c02-46d6-ad88-19487d9624b8 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:37.345008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bf243a3c-0c02-46d6-ad88-19487d9624b8 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:37.345801 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bf243a3c-0c02-46d6-ad88-19487d9624b8 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:37.346792 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bf243a3c-0c02-46d6-ad88-19487d9624b8 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:37.347469 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bf243a3c-0c02-46d6-ad88-19487d9624b8 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:37.500850 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-bf243a3c-0c02-46d6-ad88-19487d9624b8 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:37.509439 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-bf243a3c-0c02-46d6-ad88-19487d9624b8 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.176423 Jul 04 04:16:37.510602 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 155/292] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:37 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:37.700586 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1f06d41a-c07c-4a3c-bcb0-22c24a26a7b5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:37.701205 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1f06d41a-c07c-4a3c-bcb0-22c24a26a7b5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:37.707978 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f06d41a-c07c-4a3c-bcb0-22c24a26a7b5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:37.712516 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f06d41a-c07c-4a3c-bcb0-22c24a26a7b5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:37.712516 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f06d41a-c07c-4a3c-bcb0-22c24a26a7b5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:37.712516 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f06d41a-c07c-4a3c-bcb0-22c24a26a7b5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:37.755866 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-03970901-4f97-4683-8e51-5e6156c24a84 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:37.757305 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-03970901-4f97-4683-8e51-5e6156c24a84 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:37.764339 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-03970901-4f97-4683-8e51-5e6156c24a84 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:37.765121 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-03970901-4f97-4683-8e51-5e6156c24a84 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:37.766110 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-03970901-4f97-4683-8e51-5e6156c24a84 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:37.766790 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-03970901-4f97-4683-8e51-5e6156c24a84 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:37.792086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=100 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:37.926737 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1f06d41a-c07c-4a3c-bcb0-22c24a26a7b5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:37.936004 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1f06d41a-c07c-4a3c-bcb0-22c24a26a7b5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.239030 Jul 04 04:16:37.947127 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 138/293] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:37 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:37.977100 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-03970901-4f97-4683-8e51-5e6156c24a84 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:37.985731 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-03970901-4f97-4683-8e51-5e6156c24a84 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.233691 Jul 04 04:16:37.986306 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 156/294] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:37 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:38.291165 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2507f9f6-ef69-4961-ade6-b010086dc8cb tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:38.291921 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2507f9f6-ef69-4961-ade6-b010086dc8cb tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:38.298317 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2507f9f6-ef69-4961-ade6-b010086dc8cb tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:38.299200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2507f9f6-ef69-4961-ade6-b010086dc8cb tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:38.300356 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2507f9f6-ef69-4961-ade6-b010086dc8cb tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:38.300943 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2507f9f6-ef69-4961-ade6-b010086dc8cb tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:38.366654 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2507f9f6-ef69-4961-ade6-b010086dc8cb tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:38.374921 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2507f9f6-ef69-4961-ade6-b010086dc8cb tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1346 microversion: 2.1 time: 0.087657 Jul 04 04:16:38.375497 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 139/295] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:38 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:38.530235 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d6a6ac5a-2eb2-4bd4-9a30-e53a8f89c6a2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:38.530865 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d6a6ac5a-2eb2-4bd4-9a30-e53a8f89c6a2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:38.537616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d6a6ac5a-2eb2-4bd4-9a30-e53a8f89c6a2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:38.538061 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d6a6ac5a-2eb2-4bd4-9a30-e53a8f89c6a2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:38.538856 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d6a6ac5a-2eb2-4bd4-9a30-e53a8f89c6a2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:38.539281 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d6a6ac5a-2eb2-4bd4-9a30-e53a8f89c6a2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:38.724159 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d6a6ac5a-2eb2-4bd4-9a30-e53a8f89c6a2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:38.732186 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d6a6ac5a-2eb2-4bd4-9a30-e53a8f89c6a2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.205873 Jul 04 04:16:38.742285 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 157/296] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:38 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:38.953101 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-87b9c93a-8fb5-4d53-9bb7-e8511a32f264 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:38.953700 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-87b9c93a-8fb5-4d53-9bb7-e8511a32f264 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:38.960392 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87b9c93a-8fb5-4d53-9bb7-e8511a32f264 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:38.960833 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87b9c93a-8fb5-4d53-9bb7-e8511a32f264 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:38.961590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87b9c93a-8fb5-4d53-9bb7-e8511a32f264 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:38.962019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-87b9c93a-8fb5-4d53-9bb7-e8511a32f264 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:39.002773 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-476763f2-6747-4b46-8520-08e44aa477e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:39.003412 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-476763f2-6747-4b46-8520-08e44aa477e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:39.016051 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-476763f2-6747-4b46-8520-08e44aa477e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:39.016290 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-476763f2-6747-4b46-8520-08e44aa477e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:39.017065 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-476763f2-6747-4b46-8520-08e44aa477e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:39.017508 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-476763f2-6747-4b46-8520-08e44aa477e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:39.124234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-87b9c93a-8fb5-4d53-9bb7-e8511a32f264 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:39.134026 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-87b9c93a-8fb5-4d53-9bb7-e8511a32f264 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.184091 Jul 04 04:16:39.134815 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 140/297] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:38 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:39.185226 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-476763f2-6747-4b46-8520-08e44aa477e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:39.195601 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-476763f2-6747-4b46-8520-08e44aa477e7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.196651 Jul 04 04:16:39.196451 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 158/298] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:38 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:39.392238 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5b9dcdc0-a352-4309-a37f-ca5a35dfde19 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:39.392835 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5b9dcdc0-a352-4309-a37f-ca5a35dfde19 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:39.401752 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b9dcdc0-a352-4309-a37f-ca5a35dfde19 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:39.402213 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b9dcdc0-a352-4309-a37f-ca5a35dfde19 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:39.403050 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b9dcdc0-a352-4309-a37f-ca5a35dfde19 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:39.403485 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5b9dcdc0-a352-4309-a37f-ca5a35dfde19 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:39.476602 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5b9dcdc0-a352-4309-a37f-ca5a35dfde19 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:39.488171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5b9dcdc0-a352-4309-a37f-ca5a35dfde19 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1346 microversion: 2.1 time: 0.100051 Jul 04 04:16:39.488958 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 141/299] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:39 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:39.758005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3519aa53-6094-4a0d-83d6-b9cd42453be2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:39.758005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-3519aa53-6094-4a0d-83d6-b9cd42453be2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:39.767986 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3519aa53-6094-4a0d-83d6-b9cd42453be2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:39.769724 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3519aa53-6094-4a0d-83d6-b9cd42453be2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:39.770567 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3519aa53-6094-4a0d-83d6-b9cd42453be2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:39.771069 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3519aa53-6094-4a0d-83d6-b9cd42453be2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:39.956218 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-3519aa53-6094-4a0d-83d6-b9cd42453be2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:39.964087 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3519aa53-6094-4a0d-83d6-b9cd42453be2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.218161 Jul 04 04:16:39.975586 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 159/300] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:39 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:40.157665 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f3fa5237-38c0-49bb-a45d-cf07a018774d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:40.158621 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f3fa5237-38c0-49bb-a45d-cf07a018774d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:40.180389 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3fa5237-38c0-49bb-a45d-cf07a018774d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:40.181135 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3fa5237-38c0-49bb-a45d-cf07a018774d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:40.182563 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3fa5237-38c0-49bb-a45d-cf07a018774d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:40.183723 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3fa5237-38c0-49bb-a45d-cf07a018774d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:40.218639 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-55f5a776-bdc4-4a59-a1b6-24244d1de450 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:40.219690 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-55f5a776-bdc4-4a59-a1b6-24244d1de450 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:40.228692 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-55f5a776-bdc4-4a59-a1b6-24244d1de450 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:40.229557 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-55f5a776-bdc4-4a59-a1b6-24244d1de450 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:40.230512 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-55f5a776-bdc4-4a59-a1b6-24244d1de450 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:40.234224 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-55f5a776-bdc4-4a59-a1b6-24244d1de450 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:40.421938 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f3fa5237-38c0-49bb-a45d-cf07a018774d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:40.431275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f3fa5237-38c0-49bb-a45d-cf07a018774d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.281818 Jul 04 04:16:40.442170 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 142/301] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:40 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:40.478859 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-55f5a776-bdc4-4a59-a1b6-24244d1de450 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:40.486104 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-55f5a776-bdc4-4a59-a1b6-24244d1de450 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.275336 Jul 04 04:16:40.487007 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 160/302] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:40 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:40.508559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-89741475-9f1f-47fd-a4c9-4d3147b3a92c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:40.509282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-89741475-9f1f-47fd-a4c9-4d3147b3a92c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:40.515876 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89741475-9f1f-47fd-a4c9-4d3147b3a92c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:40.516389 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89741475-9f1f-47fd-a4c9-4d3147b3a92c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:40.517227 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89741475-9f1f-47fd-a4c9-4d3147b3a92c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:40.517718 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89741475-9f1f-47fd-a4c9-4d3147b3a92c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:40.589736 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-89741475-9f1f-47fd-a4c9-4d3147b3a92c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:40.597887 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-89741475-9f1f-47fd-a4c9-4d3147b3a92c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1346 microversion: 2.1 time: 0.093250 Jul 04 04:16:40.598858 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 143/303] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:40 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:40.982127 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-26ae8dae-abe9-4965-a720-9e2a93c463f6 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:40.982842 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-26ae8dae-abe9-4965-a720-9e2a93c463f6 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:40.989068 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-26ae8dae-abe9-4965-a720-9e2a93c463f6 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:40.989579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-26ae8dae-abe9-4965-a720-9e2a93c463f6 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:40.990554 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-26ae8dae-abe9-4965-a720-9e2a93c463f6 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:40.991127 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-26ae8dae-abe9-4965-a720-9e2a93c463f6 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:41.139871 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-26ae8dae-abe9-4965-a720-9e2a93c463f6 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:41.149507 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-26ae8dae-abe9-4965-a720-9e2a93c463f6 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.171292 Jul 04 04:16:41.150666 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 161/304] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:40 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:41.451544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3d52579c-199b-44c8-8f95-0ccc08a4d9d0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:41.452177 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3d52579c-199b-44c8-8f95-0ccc08a4d9d0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:41.459761 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d52579c-199b-44c8-8f95-0ccc08a4d9d0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:41.460508 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d52579c-199b-44c8-8f95-0ccc08a4d9d0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:41.461494 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d52579c-199b-44c8-8f95-0ccc08a4d9d0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:41.462076 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d52579c-199b-44c8-8f95-0ccc08a4d9d0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:41.506338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-687a4001-5571-44fb-b867-6b0f2ab7d750 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:41.507277 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-687a4001-5571-44fb-b867-6b0f2ab7d750 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:41.509367 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:41.522972 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-687a4001-5571-44fb-b867-6b0f2ab7d750 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:41.524268 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-687a4001-5571-44fb-b867-6b0f2ab7d750 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:41.527596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-687a4001-5571-44fb-b867-6b0f2ab7d750 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:41.528682 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-687a4001-5571-44fb-b867-6b0f2ab7d750 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:41.677910 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3d52579c-199b-44c8-8f95-0ccc08a4d9d0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:41.689713 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3d52579c-199b-44c8-8f95-0ccc08a4d9d0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.242192 Jul 04 04:16:41.704564 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 144/305] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:41 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:41.710494 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3ef230ff-aacd-4a57-8d2a-fb41c6d3edb4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:41.711355 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3ef230ff-aacd-4a57-8d2a-fb41c6d3edb4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:41.718119 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ef230ff-aacd-4a57-8d2a-fb41c6d3edb4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:41.719082 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ef230ff-aacd-4a57-8d2a-fb41c6d3edb4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:41.720233 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ef230ff-aacd-4a57-8d2a-fb41c6d3edb4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:41.720807 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ef230ff-aacd-4a57-8d2a-fb41c6d3edb4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:41.744850 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-687a4001-5571-44fb-b867-6b0f2ab7d750 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:41.759044 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-687a4001-5571-44fb-b867-6b0f2ab7d750 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.257844 Jul 04 04:16:41.771151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 162/306] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:41 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:41.814768 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3ef230ff-aacd-4a57-8d2a-fb41c6d3edb4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:41.823016 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3ef230ff-aacd-4a57-8d2a-fb41c6d3edb4 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1346 microversion: 2.1 time: 0.117111 Jul 04 04:16:41.823598 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 145/307] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:41 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1346 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:42.167796 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-52a34818-7264-4ddc-b1c6-1646cc809686 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:42.169768 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-52a34818-7264-4ddc-b1c6-1646cc809686 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:42.179512 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-52a34818-7264-4ddc-b1c6-1646cc809686 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:42.180379 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-52a34818-7264-4ddc-b1c6-1646cc809686 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:42.181318 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-52a34818-7264-4ddc-b1c6-1646cc809686 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:42.181816 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-52a34818-7264-4ddc-b1c6-1646cc809686 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:42.358279 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-52a34818-7264-4ddc-b1c6-1646cc809686 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:42.366093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-52a34818-7264-4ddc-b1c6-1646cc809686 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.203802 Jul 04 04:16:42.366735 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 163/308] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:42 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:42.714431 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-13071794-2683-41a2-85a6-116810925760 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:42.715360 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-13071794-2683-41a2-85a6-116810925760 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:42.724872 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13071794-2683-41a2-85a6-116810925760 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:42.725315 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13071794-2683-41a2-85a6-116810925760 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:42.726177 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13071794-2683-41a2-85a6-116810925760 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:42.726592 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13071794-2683-41a2-85a6-116810925760 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:42.778721 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a19f0941-2200-4105-9cdd-7791950552a1 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:42.779328 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a19f0941-2200-4105-9cdd-7791950552a1 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:42.785519 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a19f0941-2200-4105-9cdd-7791950552a1 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:42.785968 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a19f0941-2200-4105-9cdd-7791950552a1 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:42.786844 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a19f0941-2200-4105-9cdd-7791950552a1 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:42.787277 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a19f0941-2200-4105-9cdd-7791950552a1 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:42.868090 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-13071794-2683-41a2-85a6-116810925760 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:42.875655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-13071794-2683-41a2-85a6-116810925760 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.166884 Jul 04 04:16:42.876232 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 146/309] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:42 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:42.880924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b7d752ec-123a-41d9-9465-71fe281d1d02 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:42.881800 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b7d752ec-123a-41d9-9465-71fe281d1d02 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:42.887629 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7d752ec-123a-41d9-9465-71fe281d1d02 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:42.888090 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7d752ec-123a-41d9-9465-71fe281d1d02 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:42.889177 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7d752ec-123a-41d9-9465-71fe281d1d02 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:42.889605 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7d752ec-123a-41d9-9465-71fe281d1d02 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:42.918426 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a19f0941-2200-4105-9cdd-7791950552a1 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:42.926180 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a19f0941-2200-4105-9cdd-7791950552a1 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.151279 Jul 04 04:16:42.926755 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 164/310] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:42 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:42.949524 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b7d752ec-123a-41d9-9465-71fe281d1d02 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:42.957835 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b7d752ec-123a-41d9-9465-71fe281d1d02 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1346 microversion: 2.1 time: 0.080484 Jul 04 04:16:42.958686 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 147/311] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:42 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:43.384905 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-392a7fd5-c733-408f-bff3-b8066d77e2bc tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:43.385579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-392a7fd5-c733-408f-bff3-b8066d77e2bc tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:43.394258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-392a7fd5-c733-408f-bff3-b8066d77e2bc tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:43.394977 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-392a7fd5-c733-408f-bff3-b8066d77e2bc tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:43.396439 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-392a7fd5-c733-408f-bff3-b8066d77e2bc tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:43.398159 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-392a7fd5-c733-408f-bff3-b8066d77e2bc tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:43.545777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-392a7fd5-c733-408f-bff3-b8066d77e2bc tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:43.553344 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-392a7fd5-c733-408f-bff3-b8066d77e2bc tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.173974 Jul 04 04:16:43.553900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 165/312] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:43 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:43.892667 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7a0668af-0e0f-4011-b4b2-cbb02a8f13cf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:43.893375 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7a0668af-0e0f-4011-b4b2-cbb02a8f13cf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:43.900306 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a0668af-0e0f-4011-b4b2-cbb02a8f13cf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:43.900722 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a0668af-0e0f-4011-b4b2-cbb02a8f13cf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:43.901486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a0668af-0e0f-4011-b4b2-cbb02a8f13cf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:43.902285 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a0668af-0e0f-4011-b4b2-cbb02a8f13cf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:43.946005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-6cdfa4d4-a331-4320-8199-693344cb1592 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:43.946724 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-6cdfa4d4-a331-4320-8199-693344cb1592 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:43.954354 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6cdfa4d4-a331-4320-8199-693344cb1592 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:43.957429 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6cdfa4d4-a331-4320-8199-693344cb1592 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:43.959208 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6cdfa4d4-a331-4320-8199-693344cb1592 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:43.959456 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6cdfa4d4-a331-4320-8199-693344cb1592 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:44.075310 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7a0668af-0e0f-4011-b4b2-cbb02a8f13cf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:44.085225 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7a0668af-0e0f-4011-b4b2-cbb02a8f13cf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.196803 Jul 04 04:16:44.096208 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 148/313] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:43 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:44.107676 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1f1e15bc-05f7-48ad-9ace-28e696944691 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:44.113863 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1f1e15bc-05f7-48ad-9ace-28e696944691 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:44.125234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f1e15bc-05f7-48ad-9ace-28e696944691 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:44.126064 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f1e15bc-05f7-48ad-9ace-28e696944691 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:44.127952 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f1e15bc-05f7-48ad-9ace-28e696944691 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:44.128947 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f1e15bc-05f7-48ad-9ace-28e696944691 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:44.130852 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-6cdfa4d4-a331-4320-8199-693344cb1592 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:44.142514 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-6cdfa4d4-a331-4320-8199-693344cb1592 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.202037 Jul 04 04:16:44.143487 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 166/314] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:43 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:44.205937 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1f1e15bc-05f7-48ad-9ace-28e696944691 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:44.214525 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1f1e15bc-05f7-48ad-9ace-28e696944691 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1346 microversion: 2.1 time: 0.116305 Jul 04 04:16:44.215086 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 149/315] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:44 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1346 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:44.571003 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c1337dad-a43c-4d51-add5-c0d04e0227fb tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:44.571599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c1337dad-a43c-4d51-add5-c0d04e0227fb tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:44.578205 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c1337dad-a43c-4d51-add5-c0d04e0227fb tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:44.578692 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c1337dad-a43c-4d51-add5-c0d04e0227fb tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:44.579502 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c1337dad-a43c-4d51-add5-c0d04e0227fb tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:44.579961 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c1337dad-a43c-4d51-add5-c0d04e0227fb tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:44.721288 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c1337dad-a43c-4d51-add5-c0d04e0227fb tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:44.729015 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c1337dad-a43c-4d51-add5-c0d04e0227fb tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.162501 Jul 04 04:16:44.729612 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 167/316] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:44 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:45.115224 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b29b0112-e79a-46e5-a433-d114c21fb623 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:45.115959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b29b0112-e79a-46e5-a433-d114c21fb623 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:45.125748 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b29b0112-e79a-46e5-a433-d114c21fb623 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:45.126212 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b29b0112-e79a-46e5-a433-d114c21fb623 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:45.127036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b29b0112-e79a-46e5-a433-d114c21fb623 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:45.127483 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b29b0112-e79a-46e5-a433-d114c21fb623 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:45.160676 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a8616775-b259-4cc5-9ecd-3557fbdf5a03 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:45.161267 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a8616775-b259-4cc5-9ecd-3557fbdf5a03 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:45.167894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a8616775-b259-4cc5-9ecd-3557fbdf5a03 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:45.168338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a8616775-b259-4cc5-9ecd-3557fbdf5a03 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:45.169109 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a8616775-b259-4cc5-9ecd-3557fbdf5a03 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:45.169560 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a8616775-b259-4cc5-9ecd-3557fbdf5a03 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:45.271546 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b29b0112-e79a-46e5-a433-d114c21fb623 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:45.279382 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b29b0112-e79a-46e5-a433-d114c21fb623 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.170088 Jul 04 04:16:45.279951 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 150/317] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:45 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:45.289232 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-963dec77-ca8c-4d6c-9990-6b6cdf706a79 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:45.289232 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-963dec77-ca8c-4d6c-9990-6b6cdf706a79 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:45.293051 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-963dec77-ca8c-4d6c-9990-6b6cdf706a79 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:45.293497 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-963dec77-ca8c-4d6c-9990-6b6cdf706a79 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:45.294743 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-963dec77-ca8c-4d6c-9990-6b6cdf706a79 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:45.295433 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-963dec77-ca8c-4d6c-9990-6b6cdf706a79 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:45.312883 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:45.314264 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a8616775-b259-4cc5-9ecd-3557fbdf5a03 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:45.321806 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a8616775-b259-4cc5-9ecd-3557fbdf5a03 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.165080 Jul 04 04:16:45.322389 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 168/318] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:45 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:45.370284 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-963dec77-ca8c-4d6c-9990-6b6cdf706a79 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:45.382791 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-963dec77-ca8c-4d6c-9990-6b6cdf706a79 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1346 microversion: 2.1 time: 0.101426 Jul 04 04:16:45.383601 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 151/319] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:45 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:45.749369 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b15ab7af-0ae2-4342-a623-924cca6a04c0 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:45.750017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b15ab7af-0ae2-4342-a623-924cca6a04c0 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:45.758941 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b15ab7af-0ae2-4342-a623-924cca6a04c0 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:45.759382 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b15ab7af-0ae2-4342-a623-924cca6a04c0 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:45.760148 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b15ab7af-0ae2-4342-a623-924cca6a04c0 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:45.760576 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b15ab7af-0ae2-4342-a623-924cca6a04c0 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:45.909002 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b15ab7af-0ae2-4342-a623-924cca6a04c0 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:45.916633 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b15ab7af-0ae2-4342-a623-924cca6a04c0 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.173430 Jul 04 04:16:45.917166 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 169/320] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:45 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:46.301402 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-18ef65a4-af54-4e66-91f8-13d5a9991b73 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:46.302203 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-18ef65a4-af54-4e66-91f8-13d5a9991b73 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:46.310617 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18ef65a4-af54-4e66-91f8-13d5a9991b73 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:46.311110 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18ef65a4-af54-4e66-91f8-13d5a9991b73 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:46.311877 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18ef65a4-af54-4e66-91f8-13d5a9991b73 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:46.312359 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18ef65a4-af54-4e66-91f8-13d5a9991b73 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:46.338883 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9d7229d4-6a48-45a9-a6de-bcb50ecdda5f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:46.339479 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-9d7229d4-6a48-45a9-a6de-bcb50ecdda5f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:46.345841 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9d7229d4-6a48-45a9-a6de-bcb50ecdda5f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:46.346281 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9d7229d4-6a48-45a9-a6de-bcb50ecdda5f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:46.347092 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9d7229d4-6a48-45a9-a6de-bcb50ecdda5f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:46.347517 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9d7229d4-6a48-45a9-a6de-bcb50ecdda5f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:46.446129 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-18ef65a4-af54-4e66-91f8-13d5a9991b73 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:46.453900 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-18ef65a4-af54-4e66-91f8-13d5a9991b73 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.159535 Jul 04 04:16:46.454523 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 152/321] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:46 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:46.459246 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9cc7aed7-c628-423d-b02e-a60354eaec17 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:46.459815 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9cc7aed7-c628-423d-b02e-a60354eaec17 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:46.465961 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9cc7aed7-c628-423d-b02e-a60354eaec17 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:46.466426 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9cc7aed7-c628-423d-b02e-a60354eaec17 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:46.467352 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9cc7aed7-c628-423d-b02e-a60354eaec17 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:46.467771 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9cc7aed7-c628-423d-b02e-a60354eaec17 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:46.477961 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9d7229d4-6a48-45a9-a6de-bcb50ecdda5f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:46.485503 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9d7229d4-6a48-45a9-a6de-bcb50ecdda5f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.150639 Jul 04 04:16:46.486074 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 170/322] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:46 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:46.530960 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9cc7aed7-c628-423d-b02e-a60354eaec17 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:46.539456 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9cc7aed7-c628-423d-b02e-a60354eaec17 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1346 microversion: 2.1 time: 0.083920 Jul 04 04:16:46.540178 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 153/323] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:46 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:46.935893 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d670ddb0-5443-4062-9ef3-a9c9c5e003cb tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:46.936487 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d670ddb0-5443-4062-9ef3-a9c9c5e003cb tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:46.943126 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d670ddb0-5443-4062-9ef3-a9c9c5e003cb tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:46.943582 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d670ddb0-5443-4062-9ef3-a9c9c5e003cb tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:46.944350 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d670ddb0-5443-4062-9ef3-a9c9c5e003cb tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:46.944800 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d670ddb0-5443-4062-9ef3-a9c9c5e003cb tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:47.083569 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d670ddb0-5443-4062-9ef3-a9c9c5e003cb tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:47.091697 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d670ddb0-5443-4062-9ef3-a9c9c5e003cb tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.159805 Jul 04 04:16:47.092276 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 171/324] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:46 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:47.470892 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-15fd5a7d-6569-4eab-9b27-ecb609c97b8f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:47.471575 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-15fd5a7d-6569-4eab-9b27-ecb609c97b8f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:47.479269 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15fd5a7d-6569-4eab-9b27-ecb609c97b8f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:47.479738 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15fd5a7d-6569-4eab-9b27-ecb609c97b8f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:47.480499 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15fd5a7d-6569-4eab-9b27-ecb609c97b8f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:47.480927 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15fd5a7d-6569-4eab-9b27-ecb609c97b8f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:47.503391 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-89219a90-605e-4f72-ba52-e64f2f7f1c65 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:47.504087 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-89219a90-605e-4f72-ba52-e64f2f7f1c65 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:47.511349 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-89219a90-605e-4f72-ba52-e64f2f7f1c65 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:47.512044 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-89219a90-605e-4f72-ba52-e64f2f7f1c65 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:47.512894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-89219a90-605e-4f72-ba52-e64f2f7f1c65 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:47.513400 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-89219a90-605e-4f72-ba52-e64f2f7f1c65 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:47.625586 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-15fd5a7d-6569-4eab-9b27-ecb609c97b8f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:47.635001 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-15fd5a7d-6569-4eab-9b27-ecb609c97b8f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.168463 Jul 04 04:16:47.635685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 154/325] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:47 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:47.644317 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aff9595b-9eb0-496a-8e8e-bce381ff3d01 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:47.647620 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aff9595b-9eb0-496a-8e8e-bce381ff3d01 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:47.654033 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aff9595b-9eb0-496a-8e8e-bce381ff3d01 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:47.654502 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aff9595b-9eb0-496a-8e8e-bce381ff3d01 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:47.655037 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-89219a90-605e-4f72-ba52-e64f2f7f1c65 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:47.655277 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aff9595b-9eb0-496a-8e8e-bce381ff3d01 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:47.655708 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aff9595b-9eb0-496a-8e8e-bce381ff3d01 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:47.662480 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-89219a90-605e-4f72-ba52-e64f2f7f1c65 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.163168 Jul 04 04:16:47.663048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 172/326] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:47 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:47.719513 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aff9595b-9eb0-496a-8e8e-bce381ff3d01 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:47.732529 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aff9595b-9eb0-496a-8e8e-bce381ff3d01 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1346 microversion: 2.1 time: 0.095149 Jul 04 04:16:47.732997 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 155/327] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:47 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:48.112919 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-38cc14fd-409d-4716-8178-9df6a45be550 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:48.114673 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-38cc14fd-409d-4716-8178-9df6a45be550 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:48.124701 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-38cc14fd-409d-4716-8178-9df6a45be550 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:48.125840 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-38cc14fd-409d-4716-8178-9df6a45be550 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:48.128172 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-38cc14fd-409d-4716-8178-9df6a45be550 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:48.129070 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-38cc14fd-409d-4716-8178-9df6a45be550 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:48.135226 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=100 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:48.267450 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-38cc14fd-409d-4716-8178-9df6a45be550 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:48.275820 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-38cc14fd-409d-4716-8178-9df6a45be550 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.169921 Jul 04 04:16:48.276388 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 173/328] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:48 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:48.653253 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b2114fd2-1cd6-485e-9a85-204f1d0522d5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:48.653870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b2114fd2-1cd6-485e-9a85-204f1d0522d5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:48.661338 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b2114fd2-1cd6-485e-9a85-204f1d0522d5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:48.661795 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b2114fd2-1cd6-485e-9a85-204f1d0522d5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:48.662617 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b2114fd2-1cd6-485e-9a85-204f1d0522d5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:48.663057 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b2114fd2-1cd6-485e-9a85-204f1d0522d5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:48.679916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e1efda48-2338-45f3-9a93-6df95eefcc31 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:48.680574 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e1efda48-2338-45f3-9a93-6df95eefcc31 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:48.687648 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e1efda48-2338-45f3-9a93-6df95eefcc31 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:48.688392 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e1efda48-2338-45f3-9a93-6df95eefcc31 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:48.689160 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e1efda48-2338-45f3-9a93-6df95eefcc31 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:48.689740 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e1efda48-2338-45f3-9a93-6df95eefcc31 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:48.806455 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b2114fd2-1cd6-485e-9a85-204f1d0522d5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:48.814092 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b2114fd2-1cd6-485e-9a85-204f1d0522d5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.164867 Jul 04 04:16:48.814723 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 156/329] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:48 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:48.823984 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9cba0ab9-d109-4a8d-aff4-690da2eb8a57 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:48.823984 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9cba0ab9-d109-4a8d-aff4-690da2eb8a57 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:48.824358 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e1efda48-2338-45f3-9a93-6df95eefcc31 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:48.827329 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9cba0ab9-d109-4a8d-aff4-690da2eb8a57 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:48.828143 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9cba0ab9-d109-4a8d-aff4-690da2eb8a57 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:48.829113 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9cba0ab9-d109-4a8d-aff4-690da2eb8a57 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:48.829707 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9cba0ab9-d109-4a8d-aff4-690da2eb8a57 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:48.829896 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e1efda48-2338-45f3-9a93-6df95eefcc31 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.154145 Jul 04 04:16:48.836314 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 174/330] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:48 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:48.901580 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9cba0ab9-d109-4a8d-aff4-690da2eb8a57 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:48.913879 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9cba0ab9-d109-4a8d-aff4-690da2eb8a57 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1346 microversion: 2.1 time: 0.097855 Jul 04 04:16:48.914677 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 157/331] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:48 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:49.295620 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-93a365a3-aa72-4804-b628-ed2c81356324 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:49.296488 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-93a365a3-aa72-4804-b628-ed2c81356324 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:49.305405 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-93a365a3-aa72-4804-b628-ed2c81356324 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:49.306049 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-93a365a3-aa72-4804-b628-ed2c81356324 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:49.307164 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-93a365a3-aa72-4804-b628-ed2c81356324 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:49.307601 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-93a365a3-aa72-4804-b628-ed2c81356324 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:49.454672 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-93a365a3-aa72-4804-b628-ed2c81356324 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:49.462222 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-93a365a3-aa72-4804-b628-ed2c81356324 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.172186 Jul 04 04:16:49.463126 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 175/332] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:49 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:49.832474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3980813e-fba5-44a8-8a1f-eeee46b1ac30 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:49.833460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3980813e-fba5-44a8-8a1f-eeee46b1ac30 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:49.840670 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3980813e-fba5-44a8-8a1f-eeee46b1ac30 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:49.841118 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3980813e-fba5-44a8-8a1f-eeee46b1ac30 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:49.841891 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3980813e-fba5-44a8-8a1f-eeee46b1ac30 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:49.842322 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3980813e-fba5-44a8-8a1f-eeee46b1ac30 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:49.847448 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1c2a9261-1224-434c-ad47-c9550d71e274 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:49.848064 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-1c2a9261-1224-434c-ad47-c9550d71e274 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:49.855044 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1c2a9261-1224-434c-ad47-c9550d71e274 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:49.855538 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1c2a9261-1224-434c-ad47-c9550d71e274 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:49.856431 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1c2a9261-1224-434c-ad47-c9550d71e274 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:49.856877 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1c2a9261-1224-434c-ad47-c9550d71e274 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:49.977244 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3980813e-fba5-44a8-8a1f-eeee46b1ac30 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:49.985457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3980813e-fba5-44a8-8a1f-eeee46b1ac30 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.157176 Jul 04 04:16:49.986074 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 158/333] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:49 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:49.990720 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-965e481c-1954-4daa-a3cf-7616aa8cb595 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:49.991327 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-965e481c-1954-4daa-a3cf-7616aa8cb595 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:49.994806 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-1c2a9261-1224-434c-ad47-c9550d71e274 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:49.998270 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-965e481c-1954-4daa-a3cf-7616aa8cb595 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:49.998744 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-965e481c-1954-4daa-a3cf-7616aa8cb595 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:49.999519 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-965e481c-1954-4daa-a3cf-7616aa8cb595 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:49.999945 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-965e481c-1954-4daa-a3cf-7616aa8cb595 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:50.003020 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-1c2a9261-1224-434c-ad47-c9550d71e274 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.159395 Jul 04 04:16:50.003596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 176/334] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:49 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:50.063406 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-965e481c-1954-4daa-a3cf-7616aa8cb595 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:50.071229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-965e481c-1954-4daa-a3cf-7616aa8cb595 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1346 microversion: 2.1 time: 0.084187 Jul 04 04:16:50.071901 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 159/335] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:49 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:50.479678 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-92a6c1c9-573b-4640-9808-1e3fcc652810 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:50.480332 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-92a6c1c9-573b-4640-9808-1e3fcc652810 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:50.486799 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-92a6c1c9-573b-4640-9808-1e3fcc652810 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:50.487242 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-92a6c1c9-573b-4640-9808-1e3fcc652810 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:50.488008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-92a6c1c9-573b-4640-9808-1e3fcc652810 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:50.488436 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-92a6c1c9-573b-4640-9808-1e3fcc652810 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:50.631197 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-92a6c1c9-573b-4640-9808-1e3fcc652810 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:50.641243 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-92a6c1c9-573b-4640-9808-1e3fcc652810 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.165934 Jul 04 04:16:50.641934 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 177/336] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:50 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:51.002670 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eefe2b12-323a-4add-a13a-45fb6e7cc9a8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:51.003313 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eefe2b12-323a-4add-a13a-45fb6e7cc9a8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:51.010734 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eefe2b12-323a-4add-a13a-45fb6e7cc9a8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:51.011128 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eefe2b12-323a-4add-a13a-45fb6e7cc9a8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:51.012107 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eefe2b12-323a-4add-a13a-45fb6e7cc9a8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:51.012574 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eefe2b12-323a-4add-a13a-45fb6e7cc9a8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:51.021527 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-abe70d87-52ef-4430-987c-1a350842dddb tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:51.022257 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-abe70d87-52ef-4430-987c-1a350842dddb tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:51.029158 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-abe70d87-52ef-4430-987c-1a350842dddb tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:51.029686 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-abe70d87-52ef-4430-987c-1a350842dddb tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:51.030574 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-abe70d87-52ef-4430-987c-1a350842dddb tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:51.031090 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-abe70d87-52ef-4430-987c-1a350842dddb tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:51.200701 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-abe70d87-52ef-4430-987c-1a350842dddb tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:51.210185 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-abe70d87-52ef-4430-987c-1a350842dddb tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.193318 Jul 04 04:16:51.211126 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 178/337] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:51 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:51.215846 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c2bf4596-ada4-4148-bf60-79d8df32e63e tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:51.216447 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c2bf4596-ada4-4148-bf60-79d8df32e63e tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:51.229104 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c2bf4596-ada4-4148-bf60-79d8df32e63e tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:51.229648 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c2bf4596-ada4-4148-bf60-79d8df32e63e tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:51.230628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c2bf4596-ada4-4148-bf60-79d8df32e63e tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:51.231320 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c2bf4596-ada4-4148-bf60-79d8df32e63e tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:51.265090 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c2bf4596-ada4-4148-bf60-79d8df32e63e tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:51.265647 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c2bf4596-ada4-4148-bf60-79d8df32e63e tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:51.266193 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.objects.instance [None req-c2bf4596-ada4-4148-bf60-79d8df32e63e tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lazy-loading 'fault' on Instance uuid 0dbd2b17-e16f-4867-87bd-9e0430d8b027 {{(pid=117875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:16:51.277638 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eefe2b12-323a-4add-a13a-45fb6e7cc9a8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:51.287467 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eefe2b12-323a-4add-a13a-45fb6e7cc9a8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.288728 Jul 04 04:16:51.288350 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 160/338] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:50 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:51.312644 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c2bf4596-ada4-4148-bf60-79d8df32e63e tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17986e47d6a34cd785ff91f0a000f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14e4e69a2db416caeef8036b55805b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:51.326719 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c2bf4596-ada4-4148-bf60-79d8df32e63e tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 200 len: 1351 microversion: 2.1 time: 0.114619 Jul 04 04:16:51.327377 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 179/339] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:51 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 1351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:51.386766 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-bc9702d0-ee8d-43aa-8f73-7b5d9898e0b0 req-51d179cb-d0c8-4d8f-8ec0-4a6ca5ebe561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb07e282-565d-4780-b4e0-9fcc76ac5886", "tag": "824e9a73-e83d-443e-a6cb-c8627c01096f"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:16:51.395296 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-bc9702d0-ee8d-43aa-8f73-7b5d9898e0b0 req-51d179cb-d0c8-4d8f-8ec0-4a6ca5ebe561 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:51.395731 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-bc9702d0-ee8d-43aa-8f73-7b5d9898e0b0 req-51d179cb-d0c8-4d8f-8ec0-4a6ca5ebe561 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:51.407942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-bc9702d0-ee8d-43aa-8f73-7b5d9898e0b0 req-51d179cb-d0c8-4d8f-8ec0-4a6ca5ebe561 service nova] Creating event network-changed:824e9a73-e83d-443e-a6cb-c8627c01096f for instance fb07e282-565d-4780-b4e0-9fcc76ac5886 on hv-cinder-74216 Jul 04 04:16:51.413261 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-bc9702d0-ee8d-43aa-8f73-7b5d9898e0b0 req-51d179cb-d0c8-4d8f-8ec0-4a6ca5ebe561 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030026 Jul 04 04:16:51.414417 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 161/340] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:16:51.659664 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7093cd81-f173-483b-9104-5b1825aed456 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:51.661939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7093cd81-f173-483b-9104-5b1825aed456 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:51.671503 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7093cd81-f173-483b-9104-5b1825aed456 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:51.672155 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7093cd81-f173-483b-9104-5b1825aed456 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:51.672943 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7093cd81-f173-483b-9104-5b1825aed456 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:51.673533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7093cd81-f173-483b-9104-5b1825aed456 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:51.820043 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7093cd81-f173-483b-9104-5b1825aed456 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:51.828729 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7093cd81-f173-483b-9104-5b1825aed456 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.172778 Jul 04 04:16:51.829317 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 180/341] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:51 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:52.229519 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f676416f-0032-4419-818f-ab6cb0eeab0e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:52.230286 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f676416f-0032-4419-818f-ab6cb0eeab0e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:52.242000 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f676416f-0032-4419-818f-ab6cb0eeab0e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:52.242530 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f676416f-0032-4419-818f-ab6cb0eeab0e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:52.243598 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f676416f-0032-4419-818f-ab6cb0eeab0e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:52.244311 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f676416f-0032-4419-818f-ab6cb0eeab0e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:52.307944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f4546208-2951-4754-86c0-a2c9e5adec3b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:52.308695 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f4546208-2951-4754-86c0-a2c9e5adec3b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:52.315097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f4546208-2951-4754-86c0-a2c9e5adec3b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:52.315428 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f4546208-2951-4754-86c0-a2c9e5adec3b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:52.316311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f4546208-2951-4754-86c0-a2c9e5adec3b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:52.316813 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f4546208-2951-4754-86c0-a2c9e5adec3b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:52.456506 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f4546208-2951-4754-86c0-a2c9e5adec3b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:52.464951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-f4546208-2951-4754-86c0-a2c9e5adec3b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.163816 Jul 04 04:16:52.465523 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 181/342] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:52 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:52.470138 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-03222b42-5f7a-4bee-bc06-5c6ba80d993c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:52.470766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-03222b42-5f7a-4bee-bc06-5c6ba80d993c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:52.480261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-03222b42-5f7a-4bee-bc06-5c6ba80d993c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:52.486517 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-03222b42-5f7a-4bee-bc06-5c6ba80d993c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:52.487351 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-03222b42-5f7a-4bee-bc06-5c6ba80d993c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:52.487943 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-03222b42-5f7a-4bee-bc06-5c6ba80d993c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:52.502235 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-03222b42-5f7a-4bee-bc06-5c6ba80d993c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] HTTP exception thrown: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-03222b42-5f7a-4bee-bc06-5c6ba80d993c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Request method failure captured: Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 HTTP/1.1 Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmk1Sfl90eG_7MJvA6SOt0PmuJBX_ER6fNHhj95dxfwMLAL9Lekyh1PKCkz5iQyV3217ha3TZ4N5CEJI6qL6TU6k_Vs0v-ywzAyHskWdwKCv_V6NmpM7gplYD8_X6iZFd2qQJ4cmm4HRGUCQ1y4IklmEnxVaNJ69Nly3KnAuSDnPeeY Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: f14e4e69a2db416caeef8036b55805b6 Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-DeleteServersTestJSON-1359887530 Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:16:52.507093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:16:52.508414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14e4e69a2db416caeef8036b55805b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14e4e69a2db416caeef8036b55805b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14e4e69a2db416caeef8036b55805b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14e4e69a2db416caeef8036b55805b6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:16:52.508414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-DeleteServersTestJSON-1359887530 Jul 04 04:16:52.508414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: f14e4e69a2db416caeef8036b55805b6 Jul 04 04:16:52.508414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-DeleteServersTestJSON-1359887530 Jul 04 04:16:52.508414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-DeleteServersTestJSON-1359887530-project Jul 04 04:16:52.508414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:16:52.508414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:16:52.508414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 17986e47d6a34cd785ff91f0a000f2b5 Jul 04 04:16:52.508414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-DeleteServersTestJSON-1359887530-project Jul 04 04:16:52.508414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:16:52.508414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:52.508414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': '0dbd2b17-e16f-4867-87bd-9e0430d8b027'} Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:16:52.509581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:16:52.511167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:16:52.511167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:16:52.511167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:16:52.511167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:16:52.511167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:16:52.511167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:16:52.511167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:16:52.511167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:52.511167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:16:52.511167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:16:52.511167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:16:52.511167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:16:52.511167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:16:52.511167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:16:52.511167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:16:52.511167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:16:52.511167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:52.511167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:16:52.512418 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-03222b42-5f7a-4bee-bc06-5c6ba80d993c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Returning 404 to user: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:16:52.512418 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-03222b42-5f7a-4bee-bc06-5c6ba80d993c tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 404 len: 111 microversion: 2.1 time: 0.041880 Jul 04 04:16:52.512418 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 182/343] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:52 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:16:52.586546 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f676416f-0032-4419-818f-ab6cb0eeab0e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:52.597052 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f676416f-0032-4419-818f-ab6cb0eeab0e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.372825 Jul 04 04:16:52.601498 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 162/344] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:52 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:52.633480 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5eb96cb3-f145-4502-9195-9e87dc086016 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:52.635442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5eb96cb3-f145-4502-9195-9e87dc086016 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:52.644694 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5eb96cb3-f145-4502-9195-9e87dc086016 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:52.645185 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5eb96cb3-f145-4502-9195-9e87dc086016 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:52.646064 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5eb96cb3-f145-4502-9195-9e87dc086016 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:52.646565 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5eb96cb3-f145-4502-9195-9e87dc086016 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:52.662646 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-5eb96cb3-f145-4502-9195-9e87dc086016 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] HTTP exception thrown: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5eb96cb3-f145-4502-9195-9e87dc086016 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Request method failure captured: Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027/os-volume_attachments HTTP/1.1 Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmk1Sfl90eG_7MJvA6SOt0PmuJBX_ER6fNHhj95dxfwMLAL9Lekyh1PKCkz5iQyV3217ha3TZ4N5CEJI6qL6TU6k_Vs0v-ywzAyHskWdwKCv_V6NmpM7gplYD8_X6iZFd2qQJ4cmm4HRGUCQ1y4IklmEnxVaNJ69Nly3KnAuSDnPeeY Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: f14e4e69a2db416caeef8036b55805b6 Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-DeleteServersTestJSON-1359887530 Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:16:52.664430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:16:52.665856 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14e4e69a2db416caeef8036b55805b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14e4e69a2db416caeef8036b55805b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14e4e69a2db416caeef8036b55805b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14e4e69a2db416caeef8036b55805b6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:16:52.665856 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-DeleteServersTestJSON-1359887530 Jul 04 04:16:52.665856 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: f14e4e69a2db416caeef8036b55805b6 Jul 04 04:16:52.665856 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-DeleteServersTestJSON-1359887530 Jul 04 04:16:52.665856 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-DeleteServersTestJSON-1359887530-project Jul 04 04:16:52.665856 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:16:52.665856 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:16:52.665856 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 17986e47d6a34cd785ff91f0a000f2b5 Jul 04 04:16:52.665856 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-DeleteServersTestJSON-1359887530-project Jul 04 04:16:52.665856 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:16:52.665856 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:52.665856 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'server_id': '0dbd2b17-e16f-4867-87bd-9e0430d8b027'} Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:16:52.666533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:52.667710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:16:52.668784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5eb96cb3-f145-4502-9195-9e87dc086016 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Returning 404 to user: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:16:52.668784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5eb96cb3-f145-4502-9195-9e87dc086016 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038233 Jul 04 04:16:52.668784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 183/345] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:16:52 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 04:16:52.846713 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b0cbc4c8-d09e-4daf-b69d-1db754c45c7d tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:52.847539 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b0cbc4c8-d09e-4daf-b69d-1db754c45c7d tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:52.855995 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0cbc4c8-d09e-4daf-b69d-1db754c45c7d tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:52.856557 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0cbc4c8-d09e-4daf-b69d-1db754c45c7d tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:52.857435 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0cbc4c8-d09e-4daf-b69d-1db754c45c7d tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:52.857979 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0cbc4c8-d09e-4daf-b69d-1db754c45c7d tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:53.188829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b0cbc4c8-d09e-4daf-b69d-1db754c45c7d tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:53.196563 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b0cbc4c8-d09e-4daf-b69d-1db754c45c7d tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.354761 Jul 04 04:16:53.197432 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 163/346] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:52 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:53.482813 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-75b9f9c3-54e1-4787-97ba-8fdbc7ce864d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:53.483422 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-75b9f9c3-54e1-4787-97ba-8fdbc7ce864d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:53.489960 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-75b9f9c3-54e1-4787-97ba-8fdbc7ce864d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:53.490528 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-75b9f9c3-54e1-4787-97ba-8fdbc7ce864d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:53.491460 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-75b9f9c3-54e1-4787-97ba-8fdbc7ce864d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:53.491965 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-75b9f9c3-54e1-4787-97ba-8fdbc7ce864d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:53.615082 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1c482bdd-0731-4a4c-a82f-66ba8aadcd0b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:53.615682 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1c482bdd-0731-4a4c-a82f-66ba8aadcd0b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:53.623529 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c482bdd-0731-4a4c-a82f-66ba8aadcd0b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:53.624087 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c482bdd-0731-4a4c-a82f-66ba8aadcd0b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:53.624958 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c482bdd-0731-4a4c-a82f-66ba8aadcd0b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:53.625433 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c482bdd-0731-4a4c-a82f-66ba8aadcd0b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:53.638416 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-75b9f9c3-54e1-4787-97ba-8fdbc7ce864d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:53.646437 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-75b9f9c3-54e1-4787-97ba-8fdbc7ce864d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.167880 Jul 04 04:16:53.647039 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 184/347] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:53 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:53.767542 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1c482bdd-0731-4a4c-a82f-66ba8aadcd0b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:53.778107 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1c482bdd-0731-4a4c-a82f-66ba8aadcd0b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.168251 Jul 04 04:16:53.778743 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 164/348] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:53 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:53.896175 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b075dee6-1010-4611-9563-a497bc3ccc23 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:53.896806 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b075dee6-1010-4611-9563-a497bc3ccc23 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:53.903898 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b075dee6-1010-4611-9563-a497bc3ccc23 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:53.904332 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b075dee6-1010-4611-9563-a497bc3ccc23 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:53.905099 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b075dee6-1010-4611-9563-a497bc3ccc23 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:53.905536 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b075dee6-1010-4611-9563-a497bc3ccc23 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:53.920391 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-b075dee6-1010-4611-9563-a497bc3ccc23 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] HTTP exception thrown: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b075dee6-1010-4611-9563-a497bc3ccc23 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Request method failure captured: Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: DELETE /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 HTTP/1.1 Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmk1Sfl90eG_7MJvA6SOt0PmuJBX_ER6fNHhj95dxfwMLAL9Lekyh1PKCkz5iQyV3217ha3TZ4N5CEJI6qL6TU6k_Vs0v-ywzAyHskWdwKCv_V6NmpM7gplYD8_X6iZFd2qQJ4cmm4HRGUCQ1y4IklmEnxVaNJ69Nly3KnAuSDnPeeY Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: f14e4e69a2db416caeef8036b55805b6 Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-DeleteServersTestJSON-1359887530 Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:16:53.921981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:16:53.924258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14e4e69a2db416caeef8036b55805b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14e4e69a2db416caeef8036b55805b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14e4e69a2db416caeef8036b55805b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14e4e69a2db416caeef8036b55805b6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:16:53.924258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-DeleteServersTestJSON-1359887530 Jul 04 04:16:53.924258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: f14e4e69a2db416caeef8036b55805b6 Jul 04 04:16:53.924258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-DeleteServersTestJSON-1359887530 Jul 04 04:16:53.924258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-DeleteServersTestJSON-1359887530-project Jul 04 04:16:53.924258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:16:53.924258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:16:53.924258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 17986e47d6a34cd785ff91f0a000f2b5 Jul 04 04:16:53.924258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-DeleteServersTestJSON-1359887530-project Jul 04 04:16:53.924258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:16:53.924258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:53.924258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': '0dbd2b17-e16f-4867-87bd-9e0430d8b027'} Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:16:53.924935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:53.926001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:16:53.927114 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b075dee6-1010-4611-9563-a497bc3ccc23 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Returning 404 to user: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:16:53.927114 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b075dee6-1010-4611-9563-a497bc3ccc23 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 404 len: 111 microversion: 2.1 time: 0.031219 Jul 04 04:16:53.927114 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 185/349] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:16:53 2022] DELETE /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:16:53.932691 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dfad5c73-ca08-4a77-81ce-4e9696155ae8 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:53.933298 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dfad5c73-ca08-4a77-81ce-4e9696155ae8 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] [instance: 0dbd2b17-e16f-4867-87bd-9e0430d8b027] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:53.939541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dfad5c73-ca08-4a77-81ce-4e9696155ae8 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:53.939993 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dfad5c73-ca08-4a77-81ce-4e9696155ae8 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:53.940790 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dfad5c73-ca08-4a77-81ce-4e9696155ae8 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:53.941222 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dfad5c73-ca08-4a77-81ce-4e9696155ae8 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:53.955453 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-dfad5c73-ca08-4a77-81ce-4e9696155ae8 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] HTTP exception thrown: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dfad5c73-ca08-4a77-81ce-4e9696155ae8 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Request method failure captured: Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 HTTP/1.1 Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmk1Sfl90eG_7MJvA6SOt0PmuJBX_ER6fNHhj95dxfwMLAL9Lekyh1PKCkz5iQyV3217ha3TZ4N5CEJI6qL6TU6k_Vs0v-ywzAyHskWdwKCv_V6NmpM7gplYD8_X6iZFd2qQJ4cmm4HRGUCQ1y4IklmEnxVaNJ69Nly3KnAuSDnPeeY Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: f14e4e69a2db416caeef8036b55805b6 Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-DeleteServersTestJSON-1359887530 Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:16:53.960133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:16:53.961689 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14e4e69a2db416caeef8036b55805b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f14e4e69a2db416caeef8036b55805b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f14e4e69a2db416caeef8036b55805b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f14e4e69a2db416caeef8036b55805b6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:16:53.961689 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-DeleteServersTestJSON-1359887530 Jul 04 04:16:53.961689 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: f14e4e69a2db416caeef8036b55805b6 Jul 04 04:16:53.961689 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-DeleteServersTestJSON-1359887530 Jul 04 04:16:53.961689 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-DeleteServersTestJSON-1359887530-project Jul 04 04:16:53.961689 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:16:53.961689 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:16:53.961689 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: 17986e47d6a34cd785ff91f0a000f2b5 Jul 04 04:16:53.961689 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-DeleteServersTestJSON-1359887530-project Jul 04 04:16:53.961689 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:16:53.961689 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:53.961689 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': '0dbd2b17-e16f-4867-87bd-9e0430d8b027'} Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:16:53.962576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:16:53.963907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:16:53.963907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:16:53.963907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:16:53.963907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:16:53.963907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:16:53.963907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:16:53.963907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:16:53.963907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:53.963907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:16:53.963907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:16:53.963907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:16:53.963907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:16:53.963907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:16:53.963907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:16:53.963907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:16:53.963907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:16:53.963907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. Jul 04 04:16:53.963907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:16:53.964904 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dfad5c73-ca08-4a77-81ce-4e9696155ae8 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] Returning 404 to user: Instance 0dbd2b17-e16f-4867-87bd-9e0430d8b027 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:16:53.964904 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dfad5c73-ca08-4a77-81ce-4e9696155ae8 tempest-DeleteServersTestJSON-1359887530 tempest-DeleteServersTestJSON-1359887530-project] 10.222.0.16 "GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027" status: 404 len: 111 microversion: 2.1 time: 0.032882 Jul 04 04:16:53.964904 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 165/350] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:53 2022] GET /compute/v2.1/servers/0dbd2b17-e16f-4867-87bd-9e0430d8b027 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:16:54.214178 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a07df9c0-f61c-45f5-933a-ac7d57866a4c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:54.214725 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a07df9c0-f61c-45f5-933a-ac7d57866a4c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:54.221460 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a07df9c0-f61c-45f5-933a-ac7d57866a4c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:54.221904 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a07df9c0-f61c-45f5-933a-ac7d57866a4c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:54.222722 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a07df9c0-f61c-45f5-933a-ac7d57866a4c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:54.223160 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a07df9c0-f61c-45f5-933a-ac7d57866a4c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:54.511537 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a07df9c0-f61c-45f5-933a-ac7d57866a4c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:54.518005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a07df9c0-f61c-45f5-933a-ac7d57866a4c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.307998 Jul 04 04:16:54.518944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 186/351] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:54 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:54.664502 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-99ead9e9-10a3-4281-ac9a-a0910228cac3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:54.665103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-99ead9e9-10a3-4281-ac9a-a0910228cac3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:54.672695 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99ead9e9-10a3-4281-ac9a-a0910228cac3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:54.673145 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99ead9e9-10a3-4281-ac9a-a0910228cac3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:54.673930 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99ead9e9-10a3-4281-ac9a-a0910228cac3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:54.674576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99ead9e9-10a3-4281-ac9a-a0910228cac3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:54.795666 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-db317fd0-489c-49ee-8087-23588a61e3df tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:54.796279 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-db317fd0-489c-49ee-8087-23588a61e3df tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:54.815912 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db317fd0-489c-49ee-8087-23588a61e3df tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:54.815912 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db317fd0-489c-49ee-8087-23588a61e3df tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:54.816614 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db317fd0-489c-49ee-8087-23588a61e3df tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:54.817054 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db317fd0-489c-49ee-8087-23588a61e3df tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:54.843597 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-99ead9e9-10a3-4281-ac9a-a0910228cac3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:54.854493 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-99ead9e9-10a3-4281-ac9a-a0910228cac3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.192712 Jul 04 04:16:54.855323 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 166/352] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:54 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:55.054303 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-db317fd0-489c-49ee-8087-23588a61e3df tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:55.062713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-db317fd0-489c-49ee-8087-23588a61e3df tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.271010 Jul 04 04:16:55.063300 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 187/353] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:54 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:16:55.536677 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d548c65b-b1c0-4447-99be-68b50d209d4f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:55.537290 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d548c65b-b1c0-4447-99be-68b50d209d4f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:55.550582 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d548c65b-b1c0-4447-99be-68b50d209d4f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:55.551468 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d548c65b-b1c0-4447-99be-68b50d209d4f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:55.552423 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d548c65b-b1c0-4447-99be-68b50d209d4f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:55.553025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d548c65b-b1c0-4447-99be-68b50d209d4f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:55.710954 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d548c65b-b1c0-4447-99be-68b50d209d4f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:55.726441 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d548c65b-b1c0-4447-99be-68b50d209d4f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.194669 Jul 04 04:16:55.727031 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 167/354] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:55 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:55.888120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-4e336cef-2859-4f9b-901d-84a0da7280fe tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:55.890464 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-4e336cef-2859-4f9b-901d-84a0da7280fe tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:55.898672 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4e336cef-2859-4f9b-901d-84a0da7280fe tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:55.899124 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4e336cef-2859-4f9b-901d-84a0da7280fe tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:55.901277 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4e336cef-2859-4f9b-901d-84a0da7280fe tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:55.902164 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4e336cef-2859-4f9b-901d-84a0da7280fe tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:56.082762 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e57d28e5-c831-4ee3-b556-13162bbe02f3 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:56.084066 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e57d28e5-c831-4ee3-b556-13162bbe02f3 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:56.092387 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e57d28e5-c831-4ee3-b556-13162bbe02f3 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:56.093037 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e57d28e5-c831-4ee3-b556-13162bbe02f3 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:56.094005 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e57d28e5-c831-4ee3-b556-13162bbe02f3 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:56.094619 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e57d28e5-c831-4ee3-b556-13162bbe02f3 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:56.126848 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-4e336cef-2859-4f9b-901d-84a0da7280fe tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:56.135255 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-4e336cef-2859-4f9b-901d-84a0da7280fe tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.266439 Jul 04 04:16:56.135479 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 188/355] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:55 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:56.295902 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e57d28e5-c831-4ee3-b556-13162bbe02f3 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:56.315861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e57d28e5-c831-4ee3-b556-13162bbe02f3 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.237597 Jul 04 04:16:56.316907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 168/356] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:56 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:56.744185 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-60c71608-e3c9-457b-86f8-5efa77c3f2c4 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:56.744798 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-60c71608-e3c9-457b-86f8-5efa77c3f2c4 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:56.751638 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-60c71608-e3c9-457b-86f8-5efa77c3f2c4 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:56.752094 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-60c71608-e3c9-457b-86f8-5efa77c3f2c4 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:56.752895 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-60c71608-e3c9-457b-86f8-5efa77c3f2c4 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:56.753288 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-60c71608-e3c9-457b-86f8-5efa77c3f2c4 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:57.154732 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-475965c6-94fd-4b59-96ec-561b4954dc39 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:57.155578 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-475965c6-94fd-4b59-96ec-561b4954dc39 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:57.162361 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-475965c6-94fd-4b59-96ec-561b4954dc39 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:57.162969 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-475965c6-94fd-4b59-96ec-561b4954dc39 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:57.164511 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-475965c6-94fd-4b59-96ec-561b4954dc39 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:57.165396 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-475965c6-94fd-4b59-96ec-561b4954dc39 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:57.173740 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-60c71608-e3c9-457b-86f8-5efa77c3f2c4 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:57.187959 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-60c71608-e3c9-457b-86f8-5efa77c3f2c4 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.447949 Jul 04 04:16:57.189134 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 189/357] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:56 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:57.201590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:57.333292 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-db37d687-53d6-4e4f-b2f4-f4c1e6dafcbf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:57.333889 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-db37d687-53d6-4e4f-b2f4-f4c1e6dafcbf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:57.340482 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db37d687-53d6-4e4f-b2f4-f4c1e6dafcbf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:57.340911 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db37d687-53d6-4e4f-b2f4-f4c1e6dafcbf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:57.341675 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db37d687-53d6-4e4f-b2f4-f4c1e6dafcbf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:57.342298 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db37d687-53d6-4e4f-b2f4-f4c1e6dafcbf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:57.429326 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-475965c6-94fd-4b59-96ec-561b4954dc39 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:57.438449 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-475965c6-94fd-4b59-96ec-561b4954dc39 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.289586 Jul 04 04:16:57.439518 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 169/358] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:57 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:57.492647 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-db37d687-53d6-4e4f-b2f4-f4c1e6dafcbf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:57.500313 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-db37d687-53d6-4e4f-b2f4-f4c1e6dafcbf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.170936 Jul 04 04:16:57.500887 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 190/359] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:57 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:58.205040 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ba3b5011-8900-40b1-8938-49358063ca12 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:58.205597 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ba3b5011-8900-40b1-8938-49358063ca12 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:58.212420 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba3b5011-8900-40b1-8938-49358063ca12 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:58.212863 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba3b5011-8900-40b1-8938-49358063ca12 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:58.213673 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba3b5011-8900-40b1-8938-49358063ca12 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:58.214259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba3b5011-8900-40b1-8938-49358063ca12 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:58.365916 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ba3b5011-8900-40b1-8938-49358063ca12 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:58.373857 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ba3b5011-8900-40b1-8938-49358063ca12 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.172771 Jul 04 04:16:58.374579 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 170/360] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:58 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:58.455333 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-20ae5a74-ce35-4462-843d-14b7bfe910da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:58.456022 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-20ae5a74-ce35-4462-843d-14b7bfe910da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:58.462357 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-20ae5a74-ce35-4462-843d-14b7bfe910da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:58.462944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-20ae5a74-ce35-4462-843d-14b7bfe910da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:58.463635 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-20ae5a74-ce35-4462-843d-14b7bfe910da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:58.464065 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-20ae5a74-ce35-4462-843d-14b7bfe910da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:58.485892 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=100 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:58.519522 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f8de60e2-356e-4008-961f-b189a085ddca tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:58.520268 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f8de60e2-356e-4008-961f-b189a085ddca tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:58.526860 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8de60e2-356e-4008-961f-b189a085ddca tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:58.527303 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8de60e2-356e-4008-961f-b189a085ddca tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:58.528065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8de60e2-356e-4008-961f-b189a085ddca tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:58.528489 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8de60e2-356e-4008-961f-b189a085ddca tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:58.653999 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-20ae5a74-ce35-4462-843d-14b7bfe910da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:58.662910 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-20ae5a74-ce35-4462-843d-14b7bfe910da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.211416 Jul 04 04:16:58.664206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 191/361] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:58 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:58.680018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f8de60e2-356e-4008-961f-b189a085ddca tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:58.687634 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f8de60e2-356e-4008-961f-b189a085ddca tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.173847 Jul 04 04:16:58.688211 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 171/362] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:58 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:59.391000 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a7598f03-c6be-4c83-b9e0-1333f76d1e86 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:59.391606 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a7598f03-c6be-4c83-b9e0-1333f76d1e86 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:59.397851 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a7598f03-c6be-4c83-b9e0-1333f76d1e86 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:59.398299 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a7598f03-c6be-4c83-b9e0-1333f76d1e86 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:59.399212 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a7598f03-c6be-4c83-b9e0-1333f76d1e86 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:59.399523 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a7598f03-c6be-4c83-b9e0-1333f76d1e86 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:59.532143 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a7598f03-c6be-4c83-b9e0-1333f76d1e86 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:59.539857 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a7598f03-c6be-4c83-b9e0-1333f76d1e86 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.153097 Jul 04 04:16:59.540478 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 192/363] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:59 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:59.680539 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d8a73ec0-46bf-4d2c-9ea2-09eef25e2bf1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:59.681990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d8a73ec0-46bf-4d2c-9ea2-09eef25e2bf1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:59.688609 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8a73ec0-46bf-4d2c-9ea2-09eef25e2bf1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:59.689060 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8a73ec0-46bf-4d2c-9ea2-09eef25e2bf1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:59.689944 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8a73ec0-46bf-4d2c-9ea2-09eef25e2bf1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:59.690443 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d8a73ec0-46bf-4d2c-9ea2-09eef25e2bf1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:59.705165 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1674c2d4-c151-4e30-a481-fb7925338b31 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:16:59.705867 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-1674c2d4-c151-4e30-a481-fb7925338b31 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:16:59.712481 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1674c2d4-c151-4e30-a481-fb7925338b31 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:59.713011 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1674c2d4-c151-4e30-a481-fb7925338b31 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:59.714051 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1674c2d4-c151-4e30-a481-fb7925338b31 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:16:59.714628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1674c2d4-c151-4e30-a481-fb7925338b31 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:16:59.853959 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-1674c2d4-c151-4e30-a481-fb7925338b31 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:59.862022 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-1674c2d4-c151-4e30-a481-fb7925338b31 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.160699 Jul 04 04:16:59.862776 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 193/364] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:59 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:16:59.905492 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d8a73ec0-46bf-4d2c-9ea2-09eef25e2bf1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:16:59.913075 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d8a73ec0-46bf-4d2c-9ea2-09eef25e2bf1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.236747 Jul 04 04:16:59.913648 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 172/365] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:16:59 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:17:00.556679 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d042bebb-e42d-4bad-94f2-3ddb086bed1c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:00.557472 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d042bebb-e42d-4bad-94f2-3ddb086bed1c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:00.564043 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d042bebb-e42d-4bad-94f2-3ddb086bed1c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:00.564494 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d042bebb-e42d-4bad-94f2-3ddb086bed1c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:00.565273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d042bebb-e42d-4bad-94f2-3ddb086bed1c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:00.565705 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d042bebb-e42d-4bad-94f2-3ddb086bed1c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:00.807123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d042bebb-e42d-4bad-94f2-3ddb086bed1c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:00.816036 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d042bebb-e42d-4bad-94f2-3ddb086bed1c tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.263475 Jul 04 04:17:00.816607 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 194/366] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:00 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:00.879603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c09200bf-a078-4b38-b785-b225b5bf669f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:00.880406 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c09200bf-a078-4b38-b785-b225b5bf669f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:00.888222 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c09200bf-a078-4b38-b785-b225b5bf669f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:00.889123 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c09200bf-a078-4b38-b785-b225b5bf669f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:00.890049 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c09200bf-a078-4b38-b785-b225b5bf669f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:00.890610 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c09200bf-a078-4b38-b785-b225b5bf669f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:00.930575 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-97d1a603-aab8-4665-94d1-e3b74d92fd0c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:00.932115 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-97d1a603-aab8-4665-94d1-e3b74d92fd0c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:00.938717 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-97d1a603-aab8-4665-94d1-e3b74d92fd0c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:00.939391 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-97d1a603-aab8-4665-94d1-e3b74d92fd0c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:00.940311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-97d1a603-aab8-4665-94d1-e3b74d92fd0c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:00.940888 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-97d1a603-aab8-4665-94d1-e3b74d92fd0c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:01.048956 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c09200bf-a078-4b38-b785-b225b5bf669f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:01.059083 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c09200bf-a078-4b38-b785-b225b5bf669f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.183271 Jul 04 04:17:01.059674 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 173/367] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:00 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:17:01.175190 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-97d1a603-aab8-4665-94d1-e3b74d92fd0c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:01.189297 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-97d1a603-aab8-4665-94d1-e3b74d92fd0c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.262388 Jul 04 04:17:01.189886 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 195/368] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:00 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:01.833407 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-64f312f3-aeb2-4dc2-91f6-4214cc08be02 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:01.834029 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-64f312f3-aeb2-4dc2-91f6-4214cc08be02 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:01.840952 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64f312f3-aeb2-4dc2-91f6-4214cc08be02 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:01.841499 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64f312f3-aeb2-4dc2-91f6-4214cc08be02 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:01.842469 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64f312f3-aeb2-4dc2-91f6-4214cc08be02 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:01.843047 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64f312f3-aeb2-4dc2-91f6-4214cc08be02 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:02.010271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-64f312f3-aeb2-4dc2-91f6-4214cc08be02 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:02.018911 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-64f312f3-aeb2-4dc2-91f6-4214cc08be02 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.189246 Jul 04 04:17:02.028689 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 174/369] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:01 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:02.076426 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3bd5796e-061e-4cd0-9491-16eaa48602a0 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:02.077224 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-3bd5796e-061e-4cd0-9491-16eaa48602a0 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:02.084045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3bd5796e-061e-4cd0-9491-16eaa48602a0 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:02.084479 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3bd5796e-061e-4cd0-9491-16eaa48602a0 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:02.095734 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3bd5796e-061e-4cd0-9491-16eaa48602a0 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:02.096139 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3bd5796e-061e-4cd0-9491-16eaa48602a0 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:02.209766 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5a821aea-236f-4472-bf45-3f3ef0e59103 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:02.211506 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5a821aea-236f-4472-bf45-3f3ef0e59103 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:02.220389 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a821aea-236f-4472-bf45-3f3ef0e59103 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:02.220977 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a821aea-236f-4472-bf45-3f3ef0e59103 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:02.222411 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a821aea-236f-4472-bf45-3f3ef0e59103 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:02.223101 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a821aea-236f-4472-bf45-3f3ef0e59103 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:02.382144 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-3bd5796e-061e-4cd0-9491-16eaa48602a0 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:02.398779 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3bd5796e-061e-4cd0-9491-16eaa48602a0 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.326123 Jul 04 04:17:02.410578 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 196/370] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:02 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:02.428287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5a821aea-236f-4472-bf45-3f3ef0e59103 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:02.443083 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5a821aea-236f-4472-bf45-3f3ef0e59103 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.237416 Jul 04 04:17:02.443746 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 175/371] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:02 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:17:03.036286 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-93a0b704-b6bf-4b7a-89aa-30255ead45f4 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:03.036901 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-93a0b704-b6bf-4b7a-89aa-30255ead45f4 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:03.043203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-93a0b704-b6bf-4b7a-89aa-30255ead45f4 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:03.043629 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-93a0b704-b6bf-4b7a-89aa-30255ead45f4 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:03.044818 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-93a0b704-b6bf-4b7a-89aa-30255ead45f4 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:03.045491 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-93a0b704-b6bf-4b7a-89aa-30255ead45f4 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:03.237806 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-5e502ee5-7bdf-4640-8c2e-af32f893dbc4 req-9df14349-d149-40e5-9efe-cbd6289eaf4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1e5292-d768-4e52-b4e1-91ef1e02e688", "name": "network-vif-plugged", "status": "completed", "tag": "bb2c5801-9617-4283-b348-91c2765ed7fd"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:03.248431 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-5e502ee5-7bdf-4640-8c2e-af32f893dbc4 req-9df14349-d149-40e5-9efe-cbd6289eaf4f service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:03.249330 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-5e502ee5-7bdf-4640-8c2e-af32f893dbc4 req-9df14349-d149-40e5-9efe-cbd6289eaf4f service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:03.257487 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-93a0b704-b6bf-4b7a-89aa-30255ead45f4 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:03.268431 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-93a0b704-b6bf-4b7a-89aa-30255ead45f4 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.236181 Jul 04 04:17:03.269007 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 197/372] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:03 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:03.282211 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-5e502ee5-7bdf-4640-8c2e-af32f893dbc4 req-9df14349-d149-40e5-9efe-cbd6289eaf4f service nova] Creating event network-vif-plugged:bb2c5801-9617-4283-b348-91c2765ed7fd for instance db1e5292-d768-4e52-b4e1-91ef1e02e688 on hv-cinder-74216 Jul 04 04:17:03.288179 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-5e502ee5-7bdf-4640-8c2e-af32f893dbc4 req-9df14349-d149-40e5-9efe-cbd6289eaf4f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053983 Jul 04 04:17:03.288792 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 176/373] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:17:03.416865 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5e2d336f-8b3c-4109-bc03-3ee8cef2e52c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:03.417475 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5e2d336f-8b3c-4109-bc03-3ee8cef2e52c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:03.424050 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5e2d336f-8b3c-4109-bc03-3ee8cef2e52c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:03.424412 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5e2d336f-8b3c-4109-bc03-3ee8cef2e52c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:03.425182 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5e2d336f-8b3c-4109-bc03-3ee8cef2e52c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:03.425801 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5e2d336f-8b3c-4109-bc03-3ee8cef2e52c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:03.464102 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b7e7cb26-a8d3-4f9e-9715-94218a7414d2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:03.468579 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b7e7cb26-a8d3-4f9e-9715-94218a7414d2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:03.488378 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7e7cb26-a8d3-4f9e-9715-94218a7414d2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:03.488932 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7e7cb26-a8d3-4f9e-9715-94218a7414d2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:03.489909 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7e7cb26-a8d3-4f9e-9715-94218a7414d2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:03.490398 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7e7cb26-a8d3-4f9e-9715-94218a7414d2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:03.654331 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b7e7cb26-a8d3-4f9e-9715-94218a7414d2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:03.663371 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b7e7cb26-a8d3-4f9e-9715-94218a7414d2 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.206105 Jul 04 04:17:03.664342 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 177/374] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:03 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:03.697124 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5e2d336f-8b3c-4109-bc03-3ee8cef2e52c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:03.705338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5e2d336f-8b3c-4109-bc03-3ee8cef2e52c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.292325 Jul 04 04:17:03.705917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 198/375] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:03 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:04.285051 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a7849762-f847-4a45-bbf5-ab3ea8d807a2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:04.285683 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a7849762-f847-4a45-bbf5-ab3ea8d807a2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:04.302997 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7849762-f847-4a45-bbf5-ab3ea8d807a2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:04.303556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7849762-f847-4a45-bbf5-ab3ea8d807a2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:04.304211 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7849762-f847-4a45-bbf5-ab3ea8d807a2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:04.304648 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7849762-f847-4a45-bbf5-ab3ea8d807a2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:04.548608 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a7849762-f847-4a45-bbf5-ab3ea8d807a2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:04.560886 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a7849762-f847-4a45-bbf5-ab3ea8d807a2 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.279626 Jul 04 04:17:04.561762 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 178/376] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:04 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:04.683751 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dcb872f0-5947-4753-b60f-dc6e1e5e6a75 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:04.684635 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dcb872f0-5947-4753-b60f-dc6e1e5e6a75 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:04.684950 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e82a2d9c-0468-46a9-8098-7856ad8d4320 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Action: 'create', calling method: .version_select at 0x7f50c142de50>, body: {"keypair": {"name": "tempest-keypair-733379013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXHXB7mdtTZF5s6A3kDyKwSKY5rox0QU8W+Zi6blh5K9tgwi3JyXfcepA0Hq3a1NrN0pRbqxY88W+0mwb2qPinVI37ScsV1sNqiIWCTjpmvYBLbg1JtVaKz3/IL2QPcXQ=="}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:04.692921 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dcb872f0-5947-4753-b60f-dc6e1e5e6a75 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:04.693705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dcb872f0-5947-4753-b60f-dc6e1e5e6a75 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:04.694716 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dcb872f0-5947-4753-b60f-dc6e1e5e6a75 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:04.695348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dcb872f0-5947-4753-b60f-dc6e1e5e6a75 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:04.708517 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-e82a2d9c-0468-46a9-8098-7856ad8d4320 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Getting quotas for project 77e83a80c1b34e67958aca6d0a10ba8a. Resources: {'key_pairs'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:17:04.713803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-e82a2d9c-0468-46a9-8098-7856ad8d4320 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Getting quotas for user e43d573fcf384f65b7382f2d0a01ade4 and project 77e83a80c1b34e67958aca6d0a10ba8a. Resources: {'key_pairs'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:17:04.759976 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e82a2d9c-0468-46a9-8098-7856ad8d4320 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.238447 Jul 04 04:17:04.765853 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 199/377] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Jul 4 04:17:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 242 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 04 04:17:04.768434 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9569cb39-c240-4686-b2f1-1b7adfa933fb tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:04.769126 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-9569cb39-c240-4686-b2f1-1b7adfa933fb tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:04.778013 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9569cb39-c240-4686-b2f1-1b7adfa933fb tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:04.778510 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9569cb39-c240-4686-b2f1-1b7adfa933fb tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:04.779405 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9569cb39-c240-4686-b2f1-1b7adfa933fb tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:04.779923 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9569cb39-c240-4686-b2f1-1b7adfa933fb tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:04.945508 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dcb872f0-5947-4753-b60f-dc6e1e5e6a75 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:04.955376 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dcb872f0-5947-4753-b60f-dc6e1e5e6a75 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.276258 Jul 04 04:17:04.957065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 179/378] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:04 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:05.031256 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9569cb39-c240-4686-b2f1-1b7adfa933fb tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:05.041428 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9569cb39-c240-4686-b2f1-1b7adfa933fb tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.277393 Jul 04 04:17:05.042030 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 200/379] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:04 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:05.577834 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b76ab591-f703-458a-b4a1-9edddfc8bdb6 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:05.578495 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b76ab591-f703-458a-b4a1-9edddfc8bdb6 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:05.581536 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=94 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:05.589265 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b76ab591-f703-458a-b4a1-9edddfc8bdb6 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:05.589708 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b76ab591-f703-458a-b4a1-9edddfc8bdb6 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:05.590529 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b76ab591-f703-458a-b4a1-9edddfc8bdb6 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:05.591143 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b76ab591-f703-458a-b4a1-9edddfc8bdb6 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:05.945536 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b76ab591-f703-458a-b4a1-9edddfc8bdb6 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:05.953306 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b76ab591-f703-458a-b4a1-9edddfc8bdb6 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.379862 Jul 04 04:17:05.953889 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 180/380] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:05 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:05.973320 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b10c2c0b-4c2d-468a-8689-9555ddef947f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:05.973923 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b10c2c0b-4c2d-468a-8689-9555ddef947f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:05.980502 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b10c2c0b-4c2d-468a-8689-9555ddef947f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:05.980943 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b10c2c0b-4c2d-468a-8689-9555ddef947f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:05.981704 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b10c2c0b-4c2d-468a-8689-9555ddef947f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:05.982098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b10c2c0b-4c2d-468a-8689-9555ddef947f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:06.060220 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b3a5ee35-765f-410b-a319-a367fb1dd73c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:06.060835 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b3a5ee35-765f-410b-a319-a367fb1dd73c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:06.067018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3a5ee35-765f-410b-a319-a367fb1dd73c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:06.067645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3a5ee35-765f-410b-a319-a367fb1dd73c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:06.068589 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3a5ee35-765f-410b-a319-a367fb1dd73c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:06.069170 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3a5ee35-765f-410b-a319-a367fb1dd73c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:06.123673 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b10c2c0b-4c2d-468a-8689-9555ddef947f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:06.131594 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b10c2c0b-4c2d-468a-8689-9555ddef947f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.162225 Jul 04 04:17:06.132160 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 201/381] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:05 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:06.329598 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b3a5ee35-765f-410b-a319-a367fb1dd73c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:06.337237 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b3a5ee35-765f-410b-a319-a367fb1dd73c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.280553 Jul 04 04:17:06.338652 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 181/382] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:06 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:06.721912 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e7335630-2038-4297-b13a-9988de0e87df tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-993676100", "imageRef": "46b9937d-f997-401a-a3aa-bb9028764454", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4eec3fce-9c5d-44a0-be22-c0108d80e7d3"}], "security_groups": [{"name": "tempest-securitygroup--1288233013"}], "key_name": "tempest-keypair-733379013", "user_data": "}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:06.863890 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.network.neutron [None req-e7335630-2038-4297-b13a-9988de0e87df tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] validate_networks() for [('4eec3fce-9c5d-44a0-be22-c0108d80e7d3', None, None, None, None, None)] {{(pid=117875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:17:06.975859 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2b2e3e8e-7dea-4008-9619-6bb179e24d75 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:06.977460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2b2e3e8e-7dea-4008-9619-6bb179e24d75 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:06.987862 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b2e3e8e-7dea-4008-9619-6bb179e24d75 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:06.989707 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b2e3e8e-7dea-4008-9619-6bb179e24d75 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:06.992375 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b2e3e8e-7dea-4008-9619-6bb179e24d75 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:06.993450 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b2e3e8e-7dea-4008-9619-6bb179e24d75 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:07.209762 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2b2e3e8e-7dea-4008-9619-6bb179e24d75 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:07.242768 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2b2e3e8e-7dea-4008-9619-6bb179e24d75 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.273606 Jul 04 04:17:07.254535 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 182/383] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:06 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:07.260077 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2a2908b2-05b8-4f0b-b5a5-42a4156e80ea tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:07.260959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2a2908b2-05b8-4f0b-b5a5-42a4156e80ea tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:07.268032 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a2908b2-05b8-4f0b-b5a5-42a4156e80ea tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:07.268764 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a2908b2-05b8-4f0b-b5a5-42a4156e80ea tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:07.269707 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a2908b2-05b8-4f0b-b5a5-42a4156e80ea tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:07.270292 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a2908b2-05b8-4f0b-b5a5-42a4156e80ea tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:07.440980 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2a2908b2-05b8-4f0b-b5a5-42a4156e80ea tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:07.451118 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2a2908b2-05b8-4f0b-b5a5-42a4156e80ea tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.195118 Jul 04 04:17:07.454493 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 183/384] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:07 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:07.459533 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-9901766b-d473-4081-9186-d07fda77c19f req-b8ac27b2-7a4c-4d95-9a71-9a78b57cd733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb07e282-565d-4780-b4e0-9fcc76ac5886", "name": "network-vif-plugged", "status": "completed", "tag": "824e9a73-e83d-443e-a6cb-c8627c01096f"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:07.469427 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-9901766b-d473-4081-9186-d07fda77c19f req-b8ac27b2-7a4c-4d95-9a71-9a78b57cd733 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:07.469871 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-9901766b-d473-4081-9186-d07fda77c19f req-b8ac27b2-7a4c-4d95-9a71-9a78b57cd733 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:07.483311 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-9901766b-d473-4081-9186-d07fda77c19f req-b8ac27b2-7a4c-4d95-9a71-9a78b57cd733 service nova] Creating event network-vif-plugged:824e9a73-e83d-443e-a6cb-c8627c01096f for instance fb07e282-565d-4780-b4e0-9fcc76ac5886 on hv-cinder-74216 Jul 04 04:17:07.489694 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-9901766b-d473-4081-9186-d07fda77c19f req-b8ac27b2-7a4c-4d95-9a71-9a78b57cd733 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033617 Jul 04 04:17:07.491237 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 184/385] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:17:07.497722 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4013e162-e57d-4b01-bc4a-8c4e75f94daf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:07.498468 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4013e162-e57d-4b01-bc4a-8c4e75f94daf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:07.506811 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4013e162-e57d-4b01-bc4a-8c4e75f94daf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:07.507805 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4013e162-e57d-4b01-bc4a-8c4e75f94daf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:07.508808 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4013e162-e57d-4b01-bc4a-8c4e75f94daf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:07.509392 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4013e162-e57d-4b01-bc4a-8c4e75f94daf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:07.695414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-e7335630-2038-4297-b13a-9988de0e87df tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Flavor limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:17:07.695883 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-e7335630-2038-4297-b13a-9988de0e87df tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Image limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:17:07.696382 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-e7335630-2038-4297-b13a-9988de0e87df tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Flavor pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:17:07.696791 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-e7335630-2038-4297-b13a-9988de0e87df tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Image pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:17:07.697290 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-e7335630-2038-4297-b13a-9988de0e87df tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:17:07.707636 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7335630-2038-4297-b13a-9988de0e87df tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:07.708081 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7335630-2038-4297-b13a-9988de0e87df tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:07.708896 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7335630-2038-4297-b13a-9988de0e87df tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:07.709707 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7335630-2038-4297-b13a-9988de0e87df tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:07.746291 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-e7335630-2038-4297-b13a-9988de0e87df tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Getting quotas for project 77e83a80c1b34e67958aca6d0a10ba8a. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:17:07.749322 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:07.752609 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-e7335630-2038-4297-b13a-9988de0e87df tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Getting quotas for user e43d573fcf384f65b7382f2d0a01ade4 and project 77e83a80c1b34e67958aca6d0a10ba8a. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:17:07.762812 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4013e162-e57d-4b01-bc4a-8c4e75f94daf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:07.777670 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e7335630-2038-4297-b13a-9988de0e87df tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Going to run 1 instances... {{(pid=117875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:17:07.783621 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e7335630-2038-4297-b13a-9988de0e87df tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46b9937d-f997-401a-a3aa-bb9028764454',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:17:07.785702 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4013e162-e57d-4b01-bc4a-8c4e75f94daf tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.292666 Jul 04 04:17:07.786428 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 185/386] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:07 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:07.875309 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e7335630-2038-4297-b13a-9988de0e87df tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.157935 Jul 04 04:17:07.883322 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 202/387] 10.222.0.16 () {62 vars in 1187 bytes} [Mon Jul 4 04:17:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 04 04:17:07.891319 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b3bb5d01-0c04-4260-aa6c-de7850764699 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:07.892744 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b3bb5d01-0c04-4260-aa6c-de7850764699 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:07.999189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b3bb5d01-0c04-4260-aa6c-de7850764699 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:08.012022 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b3bb5d01-0c04-4260-aa6c-de7850764699 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:08.014165 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b3bb5d01-0c04-4260-aa6c-de7850764699 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:08.015420 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b3bb5d01-0c04-4260-aa6c-de7850764699 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1280 microversion: 2.20 time: 0.132989 Jul 04 04:17:08.017528 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 186/388] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:07 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1280 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:08.274967 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-859c8b59-c94a-47fe-9f52-c5c6e71f4bbd tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:08.275610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-859c8b59-c94a-47fe-9f52-c5c6e71f4bbd tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:08.292054 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-859c8b59-c94a-47fe-9f52-c5c6e71f4bbd tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:08.294913 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-859c8b59-c94a-47fe-9f52-c5c6e71f4bbd tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:08.297029 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-859c8b59-c94a-47fe-9f52-c5c6e71f4bbd tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:08.297988 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-859c8b59-c94a-47fe-9f52-c5c6e71f4bbd tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:08.473686 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7ab8f2ee-9f36-468e-989c-63dcc46b34d0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:08.474768 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7ab8f2ee-9f36-468e-989c-63dcc46b34d0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:08.480133 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-859c8b59-c94a-47fe-9f52-c5c6e71f4bbd tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:08.489028 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ab8f2ee-9f36-468e-989c-63dcc46b34d0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:08.489479 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ab8f2ee-9f36-468e-989c-63dcc46b34d0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:08.490394 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-859c8b59-c94a-47fe-9f52-c5c6e71f4bbd tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1315 microversion: 2.1 time: 0.230298 Jul 04 04:17:08.491613 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ab8f2ee-9f36-468e-989c-63dcc46b34d0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:08.492281 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ab8f2ee-9f36-468e-989c-63dcc46b34d0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:08.501505 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 203/389] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:08 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:08.650236 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7ab8f2ee-9f36-468e-989c-63dcc46b34d0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:08.658828 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7ab8f2ee-9f36-468e-989c-63dcc46b34d0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.191147 Jul 04 04:17:08.659444 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 187/390] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:08 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:08.802836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-934c80ad-7b81-4ef3-ab00-b404eafb2639 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:08.803435 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-934c80ad-7b81-4ef3-ab00-b404eafb2639 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:08.812470 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-934c80ad-7b81-4ef3-ab00-b404eafb2639 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:08.812910 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-934c80ad-7b81-4ef3-ab00-b404eafb2639 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:08.813675 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-934c80ad-7b81-4ef3-ab00-b404eafb2639 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:08.814102 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-934c80ad-7b81-4ef3-ab00-b404eafb2639 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:09.003150 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-934c80ad-7b81-4ef3-ab00-b404eafb2639 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:09.035021 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-680c3ef6-ca21-48c0-829a-2d1e3cc147c4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:09.035610 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-680c3ef6-ca21-48c0-829a-2d1e3cc147c4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:09.045574 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-934c80ad-7b81-4ef3-ab00-b404eafb2639 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.225383 Jul 04 04:17:09.048647 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 204/391] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:08 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:09.052826 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-680c3ef6-ca21-48c0-829a-2d1e3cc147c4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:09.055688 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-680c3ef6-ca21-48c0-829a-2d1e3cc147c4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:09.057076 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-680c3ef6-ca21-48c0-829a-2d1e3cc147c4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:09.057981 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-680c3ef6-ca21-48c0-829a-2d1e3cc147c4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:09.099625 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:09.177998 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-680c3ef6-ca21-48c0-829a-2d1e3cc147c4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:09.187191 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-680c3ef6-ca21-48c0-829a-2d1e3cc147c4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:09.189005 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-680c3ef6-ca21-48c0-829a-2d1e3cc147c4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:09.190150 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-680c3ef6-ca21-48c0-829a-2d1e3cc147c4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1284 microversion: 2.20 time: 0.160327 Jul 04 04:17:09.190758 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 188/392] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:09 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:09.508231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3e6bf09f-efd7-4275-bb28-d0b0dab878b3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:09.508957 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-3e6bf09f-efd7-4275-bb28-d0b0dab878b3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:09.516858 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3e6bf09f-efd7-4275-bb28-d0b0dab878b3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:09.517293 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3e6bf09f-efd7-4275-bb28-d0b0dab878b3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:09.518224 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3e6bf09f-efd7-4275-bb28-d0b0dab878b3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:09.518832 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3e6bf09f-efd7-4275-bb28-d0b0dab878b3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:09.676978 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3a9ebc38-9939-4601-8380-733ef2633f3a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:09.677296 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-3e6bf09f-efd7-4275-bb28-d0b0dab878b3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:09.678214 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3a9ebc38-9939-4601-8380-733ef2633f3a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:09.686048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3e6bf09f-efd7-4275-bb28-d0b0dab878b3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1464 microversion: 2.1 time: 0.182395 Jul 04 04:17:09.695121 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 205/393] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:09 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1464 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:09.697397 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a9ebc38-9939-4601-8380-733ef2633f3a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:09.703760 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a9ebc38-9939-4601-8380-733ef2633f3a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:09.706105 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a9ebc38-9939-4601-8380-733ef2633f3a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:09.707247 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a9ebc38-9939-4601-8380-733ef2633f3a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:09.739421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-fc65b14b-fc47-49c3-864a-d1713ce54358 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:09.739916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-fc65b14b-fc47-49c3-864a-d1713ce54358 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:09.747140 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fc65b14b-fc47-49c3-864a-d1713ce54358 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:09.747612 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fc65b14b-fc47-49c3-864a-d1713ce54358 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:09.748447 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fc65b14b-fc47-49c3-864a-d1713ce54358 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:09.749093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fc65b14b-fc47-49c3-864a-d1713ce54358 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:09.783541 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-fc65b14b-fc47-49c3-864a-d1713ce54358 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Going to try to terminate instance {{(pid=117875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:17:09.887207 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-fc65b14b-fc47-49c3-864a-d1713ce54358 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "DELETE /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 204 len: 0 microversion: 2.1 time: 0.151034 Jul 04 04:17:09.888475 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 206/394] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:17:09 2022] DELETE /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:17:09.899215 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-652e9a31-8daf-4dc5-94d2-e0e405826991 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:09.900491 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-652e9a31-8daf-4dc5-94d2-e0e405826991 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:09.908767 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-652e9a31-8daf-4dc5-94d2-e0e405826991 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:09.909593 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-652e9a31-8daf-4dc5-94d2-e0e405826991 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:09.910586 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-652e9a31-8daf-4dc5-94d2-e0e405826991 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:09.911346 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-652e9a31-8daf-4dc5-94d2-e0e405826991 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:09.942101 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3a9ebc38-9939-4601-8380-733ef2633f3a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:09.952129 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3a9ebc38-9939-4601-8380-733ef2633f3a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.280171 Jul 04 04:17:09.953146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 189/395] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:09 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:10.056522 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-652e9a31-8daf-4dc5-94d2-e0e405826991 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:10.065296 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-82ce5eff-fcd9-409c-8aae-98917b77faa2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:10.065791 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-652e9a31-8daf-4dc5-94d2-e0e405826991 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1470 microversion: 2.1 time: 0.171289 Jul 04 04:17:10.066143 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-82ce5eff-fcd9-409c-8aae-98917b77faa2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:10.070578 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 207/396] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:09 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1470 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:10.074596 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82ce5eff-fcd9-409c-8aae-98917b77faa2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:10.075121 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82ce5eff-fcd9-409c-8aae-98917b77faa2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:10.076140 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82ce5eff-fcd9-409c-8aae-98917b77faa2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:10.076898 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82ce5eff-fcd9-409c-8aae-98917b77faa2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:10.208243 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-cbc958bd-e5a3-4c7f-9769-0be3c61b8788 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:10.208849 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-cbc958bd-e5a3-4c7f-9769-0be3c61b8788 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:10.215400 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cbc958bd-e5a3-4c7f-9769-0be3c61b8788 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:10.216062 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cbc958bd-e5a3-4c7f-9769-0be3c61b8788 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:10.217058 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cbc958bd-e5a3-4c7f-9769-0be3c61b8788 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:10.217644 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cbc958bd-e5a3-4c7f-9769-0be3c61b8788 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:10.222016 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-82ce5eff-fcd9-409c-8aae-98917b77faa2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:10.228773 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:10.229998 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-82ce5eff-fcd9-409c-8aae-98917b77faa2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.168569 Jul 04 04:17:10.230958 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 190/397] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:10 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:10.291123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-cbc958bd-e5a3-4c7f-9769-0be3c61b8788 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:10.299169 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-cbc958bd-e5a3-4c7f-9769-0be3c61b8788 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:10.300653 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-cbc958bd-e5a3-4c7f-9769-0be3c61b8788 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:10.301789 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-cbc958bd-e5a3-4c7f-9769-0be3c61b8788 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1332 microversion: 2.20 time: 0.097453 Jul 04 04:17:10.302355 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 208/398] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:10 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 04:17:10.969919 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a3d61be9-dd1e-4d39-8745-659c6bbd9ddf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:10.970660 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a3d61be9-dd1e-4d39-8745-659c6bbd9ddf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:10.977776 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3d61be9-dd1e-4d39-8745-659c6bbd9ddf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:10.978231 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3d61be9-dd1e-4d39-8745-659c6bbd9ddf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:10.979290 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3d61be9-dd1e-4d39-8745-659c6bbd9ddf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:10.979724 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3d61be9-dd1e-4d39-8745-659c6bbd9ddf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:11.082989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5ec9168f-e802-430a-b5ed-9ac8d37e54c3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:11.084405 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5ec9168f-e802-430a-b5ed-9ac8d37e54c3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:11.091710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5ec9168f-e802-430a-b5ed-9ac8d37e54c3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:11.092166 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5ec9168f-e802-430a-b5ed-9ac8d37e54c3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:11.092974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5ec9168f-e802-430a-b5ed-9ac8d37e54c3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:11.093380 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5ec9168f-e802-430a-b5ed-9ac8d37e54c3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:11.133021 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a3d61be9-dd1e-4d39-8745-659c6bbd9ddf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:11.141835 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a3d61be9-dd1e-4d39-8745-659c6bbd9ddf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.176116 Jul 04 04:17:11.142459 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 191/399] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:10 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:11.228062 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5ec9168f-e802-430a-b5ed-9ac8d37e54c3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:11.235888 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5ec9168f-e802-430a-b5ed-9ac8d37e54c3 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1470 microversion: 2.1 time: 0.156753 Jul 04 04:17:11.236476 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 209/400] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:11 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:11.247391 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-14c9be63-5cc3-4dcc-a92e-2b78e78d6d33 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:11.248120 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-14c9be63-5cc3-4dcc-a92e-2b78e78d6d33 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:11.254719 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14c9be63-5cc3-4dcc-a92e-2b78e78d6d33 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:11.255148 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14c9be63-5cc3-4dcc-a92e-2b78e78d6d33 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:11.255912 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14c9be63-5cc3-4dcc-a92e-2b78e78d6d33 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:11.256347 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-14c9be63-5cc3-4dcc-a92e-2b78e78d6d33 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:11.320900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-35c22da4-348a-4ab1-a054-7878c6d3844c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:11.322103 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-35c22da4-348a-4ab1-a054-7878c6d3844c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:11.328498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-35c22da4-348a-4ab1-a054-7878c6d3844c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:11.328943 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-35c22da4-348a-4ab1-a054-7878c6d3844c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:11.329703 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-35c22da4-348a-4ab1-a054-7878c6d3844c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:11.330129 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-35c22da4-348a-4ab1-a054-7878c6d3844c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:11.387476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-14c9be63-5cc3-4dcc-a92e-2b78e78d6d33 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:11.395471 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-14c9be63-5cc3-4dcc-a92e-2b78e78d6d33 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.151974 Jul 04 04:17:11.396078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 192/401] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:11 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:11.398075 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-35c22da4-348a-4ab1-a054-7878c6d3844c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:11.406246 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-35c22da4-348a-4ab1-a054-7878c6d3844c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:11.407768 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-35c22da4-348a-4ab1-a054-7878c6d3844c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:11.408864 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-35c22da4-348a-4ab1-a054-7878c6d3844c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1340 microversion: 2.20 time: 0.091948 Jul 04 04:17:11.409456 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 210/402] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:11 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1340 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:12.160822 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3909de19-b156-455f-8fc9-59c02a19be02 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:12.162694 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3909de19-b156-455f-8fc9-59c02a19be02 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:12.172302 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3909de19-b156-455f-8fc9-59c02a19be02 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:12.172848 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3909de19-b156-455f-8fc9-59c02a19be02 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:12.173857 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3909de19-b156-455f-8fc9-59c02a19be02 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:12.174323 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3909de19-b156-455f-8fc9-59c02a19be02 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:12.254248 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3e67aa41-be97-43af-a2e0-3c838c271170 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:12.254888 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-3e67aa41-be97-43af-a2e0-3c838c271170 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:12.263042 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3e67aa41-be97-43af-a2e0-3c838c271170 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:12.264608 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3e67aa41-be97-43af-a2e0-3c838c271170 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:12.265399 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3e67aa41-be97-43af-a2e0-3c838c271170 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:12.266140 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3e67aa41-be97-43af-a2e0-3c838c271170 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:12.337334 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3909de19-b156-455f-8fc9-59c02a19be02 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:12.347011 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3909de19-b156-455f-8fc9-59c02a19be02 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.190373 Jul 04 04:17:12.347601 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 193/403] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:12 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:12.412894 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1576553c-332f-458f-bd33-66a3148de73b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:12.413823 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1576553c-332f-458f-bd33-66a3148de73b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:12.421180 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-3e67aa41-be97-43af-a2e0-3c838c271170 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:12.422593 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1576553c-332f-458f-bd33-66a3148de73b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:12.423047 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1576553c-332f-458f-bd33-66a3148de73b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:12.423831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1576553c-332f-458f-bd33-66a3148de73b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:12.424267 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1576553c-332f-458f-bd33-66a3148de73b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:12.432648 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3e67aa41-be97-43af-a2e0-3c838c271170 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1470 microversion: 2.1 time: 0.182450 Jul 04 04:17:12.433232 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 211/404] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:12 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1470 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:17:12.439362 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5f4325db-6b07-4a82-bec4-c3ac752b52cf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:12.440815 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5f4325db-6b07-4a82-bec4-c3ac752b52cf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:12.448352 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5f4325db-6b07-4a82-bec4-c3ac752b52cf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:12.449013 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5f4325db-6b07-4a82-bec4-c3ac752b52cf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:12.450818 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5f4325db-6b07-4a82-bec4-c3ac752b52cf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:12.451618 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5f4325db-6b07-4a82-bec4-c3ac752b52cf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:12.588119 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1576553c-332f-458f-bd33-66a3148de73b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:12.596265 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1576553c-332f-458f-bd33-66a3148de73b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.187969 Jul 04 04:17:12.605804 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 194/405] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:12 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:12.673119 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5f4325db-6b07-4a82-bec4-c3ac752b52cf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:12.681010 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5f4325db-6b07-4a82-bec4-c3ac752b52cf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:12.682701 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5f4325db-6b07-4a82-bec4-c3ac752b52cf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:12.683878 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5f4325db-6b07-4a82-bec4-c3ac752b52cf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1350 microversion: 2.20 time: 0.248338 Jul 04 04:17:12.684697 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 212/406] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:12 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1350 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:13.364320 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-691b56a8-baf6-45d9-b890-67b8815e4f6a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:13.364873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-691b56a8-baf6-45d9-b890-67b8815e4f6a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:13.374191 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-691b56a8-baf6-45d9-b890-67b8815e4f6a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:13.374682 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-691b56a8-baf6-45d9-b890-67b8815e4f6a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:13.375483 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-691b56a8-baf6-45d9-b890-67b8815e4f6a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:13.375913 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-691b56a8-baf6-45d9-b890-67b8815e4f6a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:13.451350 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-fd5658ec-6934-4e1c-b92c-2aba184c2e1f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:13.453127 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-fd5658ec-6934-4e1c-b92c-2aba184c2e1f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:13.462112 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fd5658ec-6934-4e1c-b92c-2aba184c2e1f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:13.462835 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fd5658ec-6934-4e1c-b92c-2aba184c2e1f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:13.464176 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fd5658ec-6934-4e1c-b92c-2aba184c2e1f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:13.464774 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fd5658ec-6934-4e1c-b92c-2aba184c2e1f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:13.626953 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-fd5658ec-6934-4e1c-b92c-2aba184c2e1f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:13.629346 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-691b56a8-baf6-45d9-b890-67b8815e4f6a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:13.635686 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-fd5658ec-6934-4e1c-b92c-2aba184c2e1f tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1470 microversion: 2.1 time: 0.189117 Jul 04 04:17:13.636475 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 213/407] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:13 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1470 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:13.643337 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-0d47ad91-58f5-49c7-a7af-c312c0c5d7f2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:13.643938 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-0d47ad91-58f5-49c7-a7af-c312c0c5d7f2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:13.648670 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-691b56a8-baf6-45d9-b890-67b8815e4f6a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.288312 Jul 04 04:17:13.649457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 195/408] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:13 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:13.651341 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0d47ad91-58f5-49c7-a7af-c312c0c5d7f2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:13.651779 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0d47ad91-58f5-49c7-a7af-c312c0c5d7f2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:13.652541 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0d47ad91-58f5-49c7-a7af-c312c0c5d7f2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:13.652966 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0d47ad91-58f5-49c7-a7af-c312c0c5d7f2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:13.715276 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a59eff5b-75ff-4f33-9c0e-cba3b19d876c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:13.716001 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a59eff5b-75ff-4f33-9c0e-cba3b19d876c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:13.734220 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a59eff5b-75ff-4f33-9c0e-cba3b19d876c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:13.734747 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a59eff5b-75ff-4f33-9c0e-cba3b19d876c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:13.735527 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a59eff5b-75ff-4f33-9c0e-cba3b19d876c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:13.735959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a59eff5b-75ff-4f33-9c0e-cba3b19d876c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:13.809219 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a59eff5b-75ff-4f33-9c0e-cba3b19d876c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:13.819706 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a59eff5b-75ff-4f33-9c0e-cba3b19d876c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:13.824146 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-0d47ad91-58f5-49c7-a7af-c312c0c5d7f2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:13.828117 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a59eff5b-75ff-4f33-9c0e-cba3b19d876c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:13.833733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-0d47ad91-58f5-49c7-a7af-c312c0c5d7f2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1356 microversion: 2.1 time: 0.195994 Jul 04 04:17:13.834304 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 214/409] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:13 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1356 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:13.835034 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a59eff5b-75ff-4f33-9c0e-cba3b19d876c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1338 microversion: 2.20 time: 0.132251 Jul 04 04:17:13.838787 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 196/410] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:13 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1338 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:14.653845 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-78eca68e-cd87-4a83-ac27-c5b19656f031 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:14.654754 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-78eca68e-cd87-4a83-ac27-c5b19656f031 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:14.664073 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-78eca68e-cd87-4a83-ac27-c5b19656f031 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:14.664414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-78eca68e-cd87-4a83-ac27-c5b19656f031 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:14.665545 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-78eca68e-cd87-4a83-ac27-c5b19656f031 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:14.666013 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-78eca68e-cd87-4a83-ac27-c5b19656f031 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:14.666161 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8ad109ee-a18e-4dc0-8185-1f34868801b0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:14.667351 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8ad109ee-a18e-4dc0-8185-1f34868801b0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:14.674165 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ad109ee-a18e-4dc0-8185-1f34868801b0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:14.674866 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ad109ee-a18e-4dc0-8185-1f34868801b0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:14.675893 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ad109ee-a18e-4dc0-8185-1f34868801b0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:14.676303 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ad109ee-a18e-4dc0-8185-1f34868801b0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:14.835735 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-78eca68e-cd87-4a83-ac27-c5b19656f031 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:14.843982 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-78eca68e-cd87-4a83-ac27-c5b19656f031 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1470 microversion: 2.1 time: 0.194064 Jul 04 04:17:14.855259 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 215/411] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:14 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1470 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:14.860410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1c892f7d-9132-46c1-a85e-a2ecaa6ca562 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:14.861152 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-1c892f7d-9132-46c1-a85e-a2ecaa6ca562 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:14.867481 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1c892f7d-9132-46c1-a85e-a2ecaa6ca562 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:14.868243 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1c892f7d-9132-46c1-a85e-a2ecaa6ca562 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:14.869116 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1c892f7d-9132-46c1-a85e-a2ecaa6ca562 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:14.869648 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1c892f7d-9132-46c1-a85e-a2ecaa6ca562 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:14.949370 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8ad109ee-a18e-4dc0-8185-1f34868801b0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:14.963749 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8ad109ee-a18e-4dc0-8185-1f34868801b0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1501 microversion: 2.1 time: 0.300251 Jul 04 04:17:14.964787 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 197/412] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:14 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1501 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:14.985760 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9a1e86fb-ca95-4836-9ac2-41173f50f945 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:14.986392 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9a1e86fb-ca95-4836-9ac2-41173f50f945 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:14.992737 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a1e86fb-ca95-4836-9ac2-41173f50f945 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:14.993184 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a1e86fb-ca95-4836-9ac2-41173f50f945 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:14.993955 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a1e86fb-ca95-4836-9ac2-41173f50f945 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:14.994403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9a1e86fb-ca95-4836-9ac2-41173f50f945 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:15.095772 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-1c892f7d-9132-46c1-a85e-a2ecaa6ca562 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:15.105724 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-1c892f7d-9132-46c1-a85e-a2ecaa6ca562 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1544 microversion: 2.1 time: 0.249239 Jul 04 04:17:15.107801 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 216/413] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:14 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1544 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:15.125867 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-8a7ec998-e336-4acd-9f87-26759a53bea3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a60f6f6b-2622-40f9-9e0e-297b0eb671e4"}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:15.127546 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-8a7ec998-e336-4acd-9f87-26759a53bea3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:15.134450 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8a7ec998-e336-4acd-9f87-26759a53bea3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:15.135544 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8a7ec998-e336-4acd-9f87-26759a53bea3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:15.136562 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8a7ec998-e336-4acd-9f87-26759a53bea3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:15.137249 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8a7ec998-e336-4acd-9f87-26759a53bea3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-8a7ec998-e336-4acd-9f87-26759a53bea3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] HTTP exception thrown: Cannot 'attach_volume' instance 6e519dd6-a044-4afa-ac1b-bf1f53611738 while it is in vm_state rescued Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-8a7ec998-e336-4acd-9f87-26759a53bea3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Request method failure captured: Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: POST /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738/os-volume_attachments HTTP/1.1 Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 74 Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmktGFBnwxVIACZValM9F_vrhCgFSRvMfNRwtdrHKuyEsmF4aiq464pUWCHoMBUPvBNYcADpX-2vxT_KraK3ReDT4FVftgwsiJAXYCECV12XOYlbBVQ1ZYULfr056xZkZOy4W69n1sC16SqMpBplnzVOrH2eQH8bDSp-6KdyeIq-sHU Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: 7ea328a1154a4a9a955e411f7eab0aa9 Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1922475267 Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:17:15.174658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:17:15.176267 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ea328a1154a4a9a955e411f7eab0aa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ea328a1154a4a9a955e411f7eab0aa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ea328a1154a4a9a955e411f7eab0aa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ea328a1154a4a9a955e411f7eab0aa9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:17:15.176267 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1922475267 Jul 04 04:17:15.176267 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: 7ea328a1154a4a9a955e411f7eab0aa9 Jul 04 04:17:15.176267 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1922475267 Jul 04 04:17:15.176267 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-ServerRescueNegativeTestJSON-1922475267-project Jul 04 04:17:15.176267 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:17:15.176267 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:17:15.176267 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: dca54bc220104e79aa727f30399f3411 Jul 04 04:17:15.176267 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1922475267-project Jul 04 04:17:15.176267 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Jul 04 04:17:15.176267 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {"volumeAttachment": {"volumeId": "a60f6f6b-2622-40f9-9e0e-297b0eb671e4"}} Jul 04 04:17:15.176267 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:17:15.177261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Cannot 'attach_volume' instance 6e519dd6-a044-4afa-ac1b-bf1f53611738 while it is in vm_state rescued Jul 04 04:17:15.177261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'server_id': '6e519dd6-a044-4afa-ac1b-bf1f53611738', 'body': {'volumeAttachment': {'volumeId': 'a60f6f6b-2622-40f9-9e0e-297b0eb671e4'}}} Jul 04 04:17:15.177261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:17:15.177261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:17:15.177261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 04 04:17:15.177261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 04 04:17:15.177261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 04:17:15.177261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 04:17:15.177261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 04 04:17:15.177261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 04 04:17:15.177261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6e519dd6-a044-4afa-ac1b-bf1f53611738 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 04 04:17:15.177261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:17:15.177261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:17:15.177261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:17:15.177261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:17:15.177261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:17:15.177261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:17:15.177261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:17:15.177261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:17:15.178847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:17:15.178847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:17:15.178847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 04:17:15.178847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 04:17:15.178847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 04:17:15.178847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 04:17:15.178847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 04:17:15.178847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 04:17:15.178847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 04 04:17:15.178847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 04 04:17:15.178847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 04 04:17:15.178847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 04 04:17:15.178847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6e519dd6-a044-4afa-ac1b-bf1f53611738 while it is in vm_state rescued Jul 04 04:17:15.178847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:17:15.178847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:17:15.178847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:17:15.178847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:17:15.178847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:17:15.178847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:17:15.180250 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:17:15.180250 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:17:15.180250 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6e519dd6-a044-4afa-ac1b-bf1f53611738 while it is in vm_state rescued Jul 04 04:17:15.180250 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:17:15.180250 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-8a7ec998-e336-4acd-9f87-26759a53bea3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Returning 409 to user: Cannot 'attach_volume' instance 6e519dd6-a044-4afa-ac1b-bf1f53611738 while it is in vm_state rescued {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:17:15.180250 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-8a7ec998-e336-4acd-9f87-26759a53bea3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "POST /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061952 Jul 04 04:17:15.180250 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 217/414] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jul 4 04:17:15 2022] POST /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738/os-volume_attachments => generated 152 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 04 04:17:15.190007 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9a1e86fb-ca95-4836-9ac2-41173f50f945 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:15.191292 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d6d66b55-c3a1-4e8e-901f-bd05acd37802 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:15.191941 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d6d66b55-c3a1-4e8e-901f-bd05acd37802 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:15.202765 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9a1e86fb-ca95-4836-9ac2-41173f50f945 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:15.206567 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9a1e86fb-ca95-4836-9ac2-41173f50f945 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:15.207975 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9a1e86fb-ca95-4836-9ac2-41173f50f945 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1338 microversion: 2.20 time: 0.227411 Jul 04 04:17:15.208196 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d6d66b55-c3a1-4e8e-901f-bd05acd37802 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:15.208418 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d6d66b55-c3a1-4e8e-901f-bd05acd37802 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:15.218389 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d6d66b55-c3a1-4e8e-901f-bd05acd37802 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:15.218788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 198/415] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:14 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1338 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:15.218897 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d6d66b55-c3a1-4e8e-901f-bd05acd37802 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:15.219021 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a3eae243-fe78-4a07-bd30-107cd466d4d8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:15.219021 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a3eae243-fe78-4a07-bd30-107cd466d4d8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:15.233515 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3eae243-fe78-4a07-bd30-107cd466d4d8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:15.234180 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3eae243-fe78-4a07-bd30-107cd466d4d8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:15.235268 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3eae243-fe78-4a07-bd30-107cd466d4d8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:15.236161 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3eae243-fe78-4a07-bd30-107cd466d4d8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:15.398644 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a3eae243-fe78-4a07-bd30-107cd466d4d8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "POST /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738/action" status: 202 len: 0 microversion: 2.1 time: 0.187819 Jul 04 04:17:15.405313 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 199/416] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 4 04:17:15 2022] POST /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:17:15.409634 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-c8e2ace7-a306-447a-b63c-7b212b30aecf req-1ea0446b-9892-4a6f-820d-8c8914f5d6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1e5292-d768-4e52-b4e1-91ef1e02e688", "name": "network-vif-deleted", "tag": "bb2c5801-9617-4283-b348-91c2765ed7fd"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:15.441251 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c8e2ace7-a306-447a-b63c-7b212b30aecf req-1ea0446b-9892-4a6f-820d-8c8914f5d6ac service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:15.441699 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c8e2ace7-a306-447a-b63c-7b212b30aecf req-1ea0446b-9892-4a6f-820d-8c8914f5d6ac service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:15.468086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d6d66b55-c3a1-4e8e-901f-bd05acd37802 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:15.470838 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-c8e2ace7-a306-447a-b63c-7b212b30aecf req-1ea0446b-9892-4a6f-820d-8c8914f5d6ac service nova] Creating event network-vif-deleted:bb2c5801-9617-4283-b348-91c2765ed7fd for instance db1e5292-d768-4e52-b4e1-91ef1e02e688 on hv-cinder-74216 Jul 04 04:17:15.479217 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d6d66b55-c3a1-4e8e-901f-bd05acd37802 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1544 microversion: 2.1 time: 0.304042 Jul 04 04:17:15.479798 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-c8e2ace7-a306-447a-b63c-7b212b30aecf req-1ea0446b-9892-4a6f-820d-8c8914f5d6ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075651 Jul 04 04:17:15.480650 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 218/417] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:15 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1544 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:15.481392 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 200/418] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:17:15.486454 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-67f7b364-761c-4b0b-82c9-b4ceffd07f99 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:15.487214 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-67f7b364-761c-4b0b-82c9-b4ceffd07f99 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:15.496194 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-67f7b364-761c-4b0b-82c9-b4ceffd07f99 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:15.496648 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-67f7b364-761c-4b0b-82c9-b4ceffd07f99 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:15.497463 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-67f7b364-761c-4b0b-82c9-b4ceffd07f99 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:15.498578 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-67f7b364-761c-4b0b-82c9-b4ceffd07f99 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:15.499165 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-70ef12c9-ae68-42ac-bd19-3621ada8a36c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:15.503159 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-70ef12c9-ae68-42ac-bd19-3621ada8a36c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:15.504134 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-70ef12c9-ae68-42ac-bd19-3621ada8a36c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Searching by: {'deleted': False, 'project_id': 'c487ee37e54042d680eccb72b046bb55'} {{(pid=117877) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 04 04:17:15.511444 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70ef12c9-ae68-42ac-bd19-3621ada8a36c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:15.512034 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70ef12c9-ae68-42ac-bd19-3621ada8a36c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:15.513157 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70ef12c9-ae68-42ac-bd19-3621ada8a36c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:15.514009 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70ef12c9-ae68-42ac-bd19-3621ada8a36c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:15.632985 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.multi_cell_list [None req-70ef12c9-ae68-42ac-bd19-3621ada8a36c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117877) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 04 04:17:15.708796 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-67f7b364-761c-4b0b-82c9-b4ceffd07f99 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:15.716794 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-67f7b364-761c-4b0b-82c9-b4ceffd07f99 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1509 microversion: 2.1 time: 0.234309 Jul 04 04:17:15.717367 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 219/419] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:15 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:15.759194 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-70ef12c9-ae68-42ac-bd19-3621ada8a36c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.265215 Jul 04 04:17:15.760920 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 201/420] 10.222.0.16 () {58 vars in 1124 bytes} [Mon Jul 4 04:17:15 2022] GET /compute/v2.1/servers => generated 342 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:17:15.771062 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e4f75573-6405-43a0-883e-cbf8c5e2c36e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:15.771688 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e4f75573-6405-43a0-883e-cbf8c5e2c36e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:15.777948 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4f75573-6405-43a0-883e-cbf8c5e2c36e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:15.778497 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4f75573-6405-43a0-883e-cbf8c5e2c36e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:15.779281 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4f75573-6405-43a0-883e-cbf8c5e2c36e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:15.779761 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4f75573-6405-43a0-883e-cbf8c5e2c36e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:15.862809 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fe4b1296-0106-4f5b-a66d-57748e3ab84d tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:15.863567 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fe4b1296-0106-4f5b-a66d-57748e3ab84d tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:15.870244 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe4b1296-0106-4f5b-a66d-57748e3ab84d tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:15.870718 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe4b1296-0106-4f5b-a66d-57748e3ab84d tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:15.871487 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe4b1296-0106-4f5b-a66d-57748e3ab84d tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:15.872012 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe4b1296-0106-4f5b-a66d-57748e3ab84d tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:15.907493 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe4b1296-0106-4f5b-a66d-57748e3ab84d tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:15.907793 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe4b1296-0106-4f5b-a66d-57748e3ab84d tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:15.908234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-fe4b1296-0106-4f5b-a66d-57748e3ab84d tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lazy-loading 'fault' on Instance uuid db1e5292-d768-4e52-b4e1-91ef1e02e688 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:17:15.915558 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e4f75573-6405-43a0-883e-cbf8c5e2c36e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:15.924478 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e4f75573-6405-43a0-883e-cbf8c5e2c36e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1544 microversion: 2.1 time: 0.157358 Jul 04 04:17:15.925148 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 220/421] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:15 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1544 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:17:15.956343 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fe4b1296-0106-4f5b-a66d-57748e3ab84d tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:15.966799 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fe4b1296-0106-4f5b-a66d-57748e3ab84d tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1305 microversion: 2.1 time: 0.107760 Jul 04 04:17:15.967375 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 202/422] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:15 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:17:16.230235 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b82428fc-fb13-475e-9bf6-d29bccb7c0cc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:16.231537 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b82428fc-fb13-475e-9bf6-d29bccb7c0cc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:16.242893 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b82428fc-fb13-475e-9bf6-d29bccb7c0cc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:16.243338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b82428fc-fb13-475e-9bf6-d29bccb7c0cc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:16.244116 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b82428fc-fb13-475e-9bf6-d29bccb7c0cc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:16.244547 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b82428fc-fb13-475e-9bf6-d29bccb7c0cc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:16.400283 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b82428fc-fb13-475e-9bf6-d29bccb7c0cc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:16.409220 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b82428fc-fb13-475e-9bf6-d29bccb7c0cc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:16.410859 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b82428fc-fb13-475e-9bf6-d29bccb7c0cc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:16.411980 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b82428fc-fb13-475e-9bf6-d29bccb7c0cc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1406 microversion: 2.20 time: 0.185664 Jul 04 04:17:16.412543 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 221/423] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:16 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:16.734744 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5d4212b1-7bd7-4a15-a597-776292fdb7f5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:16.735357 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5d4212b1-7bd7-4a15-a597-776292fdb7f5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:16.741833 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d4212b1-7bd7-4a15-a597-776292fdb7f5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:16.742285 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d4212b1-7bd7-4a15-a597-776292fdb7f5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:16.743096 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d4212b1-7bd7-4a15-a597-776292fdb7f5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:16.743526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d4212b1-7bd7-4a15-a597-776292fdb7f5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:16.880785 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5d4212b1-7bd7-4a15-a597-776292fdb7f5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:16.888608 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5d4212b1-7bd7-4a15-a597-776292fdb7f5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1509 microversion: 2.1 time: 0.157927 Jul 04 04:17:16.889500 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 203/424] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:16 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:16.986361 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-2776902c-e6fc-426b-973a-4518e1673d59 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:16.987200 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-2776902c-e6fc-426b-973a-4518e1673d59 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:16.993717 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2776902c-e6fc-426b-973a-4518e1673d59 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:16.994173 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2776902c-e6fc-426b-973a-4518e1673d59 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:16.995109 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2776902c-e6fc-426b-973a-4518e1673d59 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:16.995545 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2776902c-e6fc-426b-973a-4518e1673d59 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:17.029704 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2776902c-e6fc-426b-973a-4518e1673d59 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:17.030161 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2776902c-e6fc-426b-973a-4518e1673d59 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:17.030660 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.objects.instance [None req-2776902c-e6fc-426b-973a-4518e1673d59 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lazy-loading 'fault' on Instance uuid db1e5292-d768-4e52-b4e1-91ef1e02e688 {{(pid=117875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:17:17.072275 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-2776902c-e6fc-426b-973a-4518e1673d59 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:17.081165 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-2776902c-e6fc-426b-973a-4518e1673d59 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1305 microversion: 2.1 time: 0.099736 Jul 04 04:17:17.081739 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 222/425] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:16 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:17.434917 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-da354a36-fc00-4582-8984-e9a743f07d11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:17.435521 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-da354a36-fc00-4582-8984-e9a743f07d11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:17.442202 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-da354a36-fc00-4582-8984-e9a743f07d11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:17.442684 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-da354a36-fc00-4582-8984-e9a743f07d11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:17.443439 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-da354a36-fc00-4582-8984-e9a743f07d11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:17.443866 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-da354a36-fc00-4582-8984-e9a743f07d11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:17.446544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:17.576321 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-da354a36-fc00-4582-8984-e9a743f07d11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:17.584888 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-da354a36-fc00-4582-8984-e9a743f07d11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:17.586393 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-da354a36-fc00-4582-8984-e9a743f07d11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:17.587533 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-da354a36-fc00-4582-8984-e9a743f07d11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1406 microversion: 2.20 time: 0.159125 Jul 04 04:17:17.588098 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 204/426] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:17 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:17.647681 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-799c4133-3490-43f4-bc06-f0b7b59284cd req-6d6f6653-349f-4e26-a6e1-2ebfabb1b18b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6e151ec-4f75-4bfe-8c27-3d6ac7c72453", "tag": "72e623a1-47a8-4ba4-ae5c-a1c4eb8869fc"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:17.656697 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-799c4133-3490-43f4-bc06-f0b7b59284cd req-6d6f6653-349f-4e26-a6e1-2ebfabb1b18b service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:17.657135 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-799c4133-3490-43f4-bc06-f0b7b59284cd req-6d6f6653-349f-4e26-a6e1-2ebfabb1b18b service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:17.669214 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-799c4133-3490-43f4-bc06-f0b7b59284cd req-6d6f6653-349f-4e26-a6e1-2ebfabb1b18b service nova] Creating event network-changed:72e623a1-47a8-4ba4-ae5c-a1c4eb8869fc for instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 on hv-cinder-74216 Jul 04 04:17:17.674496 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-799c4133-3490-43f4-bc06-f0b7b59284cd req-6d6f6653-349f-4e26-a6e1-2ebfabb1b18b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030609 Jul 04 04:17:17.675076 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 223/427] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:17:17.910307 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d7a4ac0e-fb51-4285-901b-ca68e5b009f3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:17.911198 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d7a4ac0e-fb51-4285-901b-ca68e5b009f3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:17.921466 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d7a4ac0e-fb51-4285-901b-ca68e5b009f3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:17.921910 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d7a4ac0e-fb51-4285-901b-ca68e5b009f3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:17.922701 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d7a4ac0e-fb51-4285-901b-ca68e5b009f3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:17.923129 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d7a4ac0e-fb51-4285-901b-ca68e5b009f3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:18.010627 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:18.058229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d7a4ac0e-fb51-4285-901b-ca68e5b009f3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:18.066278 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d7a4ac0e-fb51-4285-901b-ca68e5b009f3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1509 microversion: 2.1 time: 0.162498 Jul 04 04:17:18.066900 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 205/428] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:17 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:18.096048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=2 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:18.096847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=10 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:18.102639 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-92ceaf43-99ae-4727-b006-8e73a7981e6e tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:18.103669 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-92ceaf43-99ae-4727-b006-8e73a7981e6e tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:18.114174 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-92ceaf43-99ae-4727-b006-8e73a7981e6e tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:18.114797 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-92ceaf43-99ae-4727-b006-8e73a7981e6e tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:18.116094 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-92ceaf43-99ae-4727-b006-8e73a7981e6e tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:18.116775 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-92ceaf43-99ae-4727-b006-8e73a7981e6e tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:18.151256 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-92ceaf43-99ae-4727-b006-8e73a7981e6e tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:18.151770 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-92ceaf43-99ae-4727-b006-8e73a7981e6e tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:18.152228 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.objects.instance [None req-92ceaf43-99ae-4727-b006-8e73a7981e6e tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lazy-loading 'fault' on Instance uuid db1e5292-d768-4e52-b4e1-91ef1e02e688 {{(pid=117875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:17:18.195726 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-92ceaf43-99ae-4727-b006-8e73a7981e6e tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:18.203933 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-92ceaf43-99ae-4727-b006-8e73a7981e6e tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1305 microversion: 2.1 time: 0.109642 Jul 04 04:17:18.204495 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 224/429] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:18 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1305 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:18.609614 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d2d83a2f-e546-4018-81bd-13e0b7c9caef tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:18.610098 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d2d83a2f-e546-4018-81bd-13e0b7c9caef tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:18.616956 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2d83a2f-e546-4018-81bd-13e0b7c9caef tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:18.617426 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2d83a2f-e546-4018-81bd-13e0b7c9caef tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:18.618202 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2d83a2f-e546-4018-81bd-13e0b7c9caef tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:18.618690 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2d83a2f-e546-4018-81bd-13e0b7c9caef tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:18.761778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d2d83a2f-e546-4018-81bd-13e0b7c9caef tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:18.770573 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d2d83a2f-e546-4018-81bd-13e0b7c9caef tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:18.772186 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d2d83a2f-e546-4018-81bd-13e0b7c9caef tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:18.773280 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d2d83a2f-e546-4018-81bd-13e0b7c9caef tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1406 microversion: 2.20 time: 0.169206 Jul 04 04:17:18.773808 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 206/430] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:18 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:19.084698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-42c570a5-7239-4539-9630-66b6d28fb73e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:19.085412 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-42c570a5-7239-4539-9630-66b6d28fb73e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:19.092879 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-42c570a5-7239-4539-9630-66b6d28fb73e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:19.093334 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-42c570a5-7239-4539-9630-66b6d28fb73e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:19.094143 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-42c570a5-7239-4539-9630-66b6d28fb73e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:19.094622 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-42c570a5-7239-4539-9630-66b6d28fb73e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:19.098769 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=100 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:19.220924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f91eabe2-4df0-43b3-81c7-37cc3bdd9847 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:19.221653 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f91eabe2-4df0-43b3-81c7-37cc3bdd9847 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:19.228648 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f91eabe2-4df0-43b3-81c7-37cc3bdd9847 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:19.229169 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f91eabe2-4df0-43b3-81c7-37cc3bdd9847 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:19.230003 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f91eabe2-4df0-43b3-81c7-37cc3bdd9847 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:19.230553 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f91eabe2-4df0-43b3-81c7-37cc3bdd9847 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:19.242907 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-42c570a5-7239-4539-9630-66b6d28fb73e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:19.250818 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-42c570a5-7239-4539-9630-66b6d28fb73e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1509 microversion: 2.1 time: 0.170703 Jul 04 04:17:19.251531 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 225/431] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:19 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:19.262992 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f91eabe2-4df0-43b3-81c7-37cc3bdd9847 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:19.263480 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f91eabe2-4df0-43b3-81c7-37cc3bdd9847 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:19.264226 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-f91eabe2-4df0-43b3-81c7-37cc3bdd9847 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lazy-loading 'fault' on Instance uuid db1e5292-d768-4e52-b4e1-91ef1e02e688 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:17:19.314091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f91eabe2-4df0-43b3-81c7-37cc3bdd9847 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce36bd6c2eb546249ed1c89130e5a04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8e115afb334317ba51e73582c1f2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:19.322251 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f91eabe2-4df0-43b3-81c7-37cc3bdd9847 tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 200 len: 1305 microversion: 2.1 time: 0.105080 Jul 04 04:17:19.323960 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 207/432] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:19 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 1305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:17:19.792273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-55309b10-3409-4db1-94bb-217fba4477da tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:19.792881 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-55309b10-3409-4db1-94bb-217fba4477da tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:19.799476 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-55309b10-3409-4db1-94bb-217fba4477da tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:19.799932 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-55309b10-3409-4db1-94bb-217fba4477da tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:19.800708 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-55309b10-3409-4db1-94bb-217fba4477da tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:19.801138 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-55309b10-3409-4db1-94bb-217fba4477da tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:19.939573 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-55309b10-3409-4db1-94bb-217fba4477da tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:19.947788 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-55309b10-3409-4db1-94bb-217fba4477da tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:19.949313 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-55309b10-3409-4db1-94bb-217fba4477da tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:19.950463 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-55309b10-3409-4db1-94bb-217fba4477da tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1406 microversion: 2.20 time: 0.162264 Jul 04 04:17:19.951059 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 226/433] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:19 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:20.268832 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b3071908-ccc7-4639-8f51-5d336984aada tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:20.270101 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b3071908-ccc7-4639-8f51-5d336984aada tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:20.277080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3071908-ccc7-4639-8f51-5d336984aada tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:20.277515 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3071908-ccc7-4639-8f51-5d336984aada tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:20.278301 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3071908-ccc7-4639-8f51-5d336984aada tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:20.278853 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3071908-ccc7-4639-8f51-5d336984aada tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:20.340242 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1e39d123-c83d-415d-942c-41ef74e610de tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:20.340945 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-1e39d123-c83d-415d-942c-41ef74e610de tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] [instance: db1e5292-d768-4e52-b4e1-91ef1e02e688] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:20.347424 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1e39d123-c83d-415d-942c-41ef74e610de tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:20.347942 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1e39d123-c83d-415d-942c-41ef74e610de tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:20.348777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1e39d123-c83d-415d-942c-41ef74e610de tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:20.349293 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1e39d123-c83d-415d-942c-41ef74e610de tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:20.363151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-1e39d123-c83d-415d-942c-41ef74e610de tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] HTTP exception thrown: Instance db1e5292-d768-4e52-b4e1-91ef1e02e688 could not be found. Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1e39d123-c83d-415d-942c-41ef74e610de tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Request method failure captured: Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 HTTP/1.1 Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmmR3QRra3bMoRZzqBqDEQb9LY7mgeJy4yJQ3ZCp4DtRS-hN0nvxIi2akOEJXLKOs1x5eb9Vb3yKaiUwuwTlIM4FhQwzVbuAU4ggOx-XXoJbrIF_UK0B5wNAB8LkBipZdsu1zOjbGvB6MFK1ncILs0i3DJ9MNsQKC7vrsr1eePfV-DI Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: 0a8e115afb334317ba51e73582c1f2e3 Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-VolumesNegativeTest-1988359779 Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:17:20.364899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:17:20.366446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a8e115afb334317ba51e73582c1f2e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0a8e115afb334317ba51e73582c1f2e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0a8e115afb334317ba51e73582c1f2e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0a8e115afb334317ba51e73582c1f2e3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:17:20.366446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-VolumesNegativeTest-1988359779 Jul 04 04:17:20.366446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: 0a8e115afb334317ba51e73582c1f2e3 Jul 04 04:17:20.366446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-VolumesNegativeTest-1988359779 Jul 04 04:17:20.366446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-VolumesNegativeTest-1988359779-project Jul 04 04:17:20.366446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:17:20.366446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:17:20.366446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: ce36bd6c2eb546249ed1c89130e5a04e Jul 04 04:17:20.366446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-VolumesNegativeTest-1988359779-project Jul 04 04:17:20.366446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:17:20.366446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance db1e5292-d768-4e52-b4e1-91ef1e02e688 could not be found. Jul 04 04:17:20.366446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': 'db1e5292-d768-4e52-b4e1-91ef1e02e688'} Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db1e5292-d768-4e52-b4e1-91ef1e02e688 could not be found. Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:17:20.367284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:17:20.368611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:17:20.368611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:17:20.368611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:17:20.368611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:17:20.368611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:17:20.368611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:17:20.368611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:17:20.368611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db1e5292-d768-4e52-b4e1-91ef1e02e688 could not be found. Jul 04 04:17:20.368611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:17:20.368611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:17:20.368611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:17:20.368611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:17:20.368611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:17:20.368611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:17:20.368611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:17:20.368611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:17:20.368611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db1e5292-d768-4e52-b4e1-91ef1e02e688 could not be found. Jul 04 04:17:20.368611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:17:20.369942 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1e39d123-c83d-415d-942c-41ef74e610de tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] Returning 404 to user: Instance db1e5292-d768-4e52-b4e1-91ef1e02e688 could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:17:20.369942 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-1e39d123-c83d-415d-942c-41ef74e610de tempest-VolumesNegativeTest-1988359779 tempest-VolumesNegativeTest-1988359779-project] 10.222.0.16 "GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688" status: 404 len: 111 microversion: 2.1 time: 0.031388 Jul 04 04:17:20.370270 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 227/434] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:20 2022] GET /compute/v2.1/servers/db1e5292-d768-4e52-b4e1-91ef1e02e688 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:17:20.436131 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b3071908-ccc7-4639-8f51-5d336984aada tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:20.444901 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b3071908-ccc7-4639-8f51-5d336984aada tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1509 microversion: 2.1 time: 0.179835 Jul 04 04:17:20.445472 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 208/435] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:20 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:20.968414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-8943372c-7a22-49c1-88cc-ae6e2bfbfb1d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:20.969121 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-8943372c-7a22-49c1-88cc-ae6e2bfbfb1d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:20.975518 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8943372c-7a22-49c1-88cc-ae6e2bfbfb1d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:20.975968 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8943372c-7a22-49c1-88cc-ae6e2bfbfb1d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:20.976789 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8943372c-7a22-49c1-88cc-ae6e2bfbfb1d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:20.977217 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8943372c-7a22-49c1-88cc-ae6e2bfbfb1d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:21.133568 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-8943372c-7a22-49c1-88cc-ae6e2bfbfb1d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:21.142655 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-8943372c-7a22-49c1-88cc-ae6e2bfbfb1d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:21.144154 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-8943372c-7a22-49c1-88cc-ae6e2bfbfb1d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:21.145262 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-8943372c-7a22-49c1-88cc-ae6e2bfbfb1d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1406 microversion: 2.20 time: 0.181000 Jul 04 04:17:21.145811 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 228/436] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:20 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:21.461275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4491cbcb-825c-4c55-b97e-a94463753fde tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:21.462543 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4491cbcb-825c-4c55-b97e-a94463753fde tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:21.484452 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4491cbcb-825c-4c55-b97e-a94463753fde tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:21.484901 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4491cbcb-825c-4c55-b97e-a94463753fde tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:21.490230 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4491cbcb-825c-4c55-b97e-a94463753fde tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:21.490709 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4491cbcb-825c-4c55-b97e-a94463753fde tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:21.720683 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4491cbcb-825c-4c55-b97e-a94463753fde tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:21.731347 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4491cbcb-825c-4c55-b97e-a94463753fde tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1509 microversion: 2.1 time: 0.273758 Jul 04 04:17:21.732380 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 209/437] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:21 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1509 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:21.822438 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7c8b7761-c45d-4b61-b873-d0921af7d1b6 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82a461f2-51fb-46e2-8cc5-91a86b7cc237"}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:21.823571 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7c8b7761-c45d-4b61-b873-d0921af7d1b6 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:21.831225 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7c8b7761-c45d-4b61-b873-d0921af7d1b6 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:21.831672 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7c8b7761-c45d-4b61-b873-d0921af7d1b6 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:21.832443 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7c8b7761-c45d-4b61-b873-d0921af7d1b6 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:21.832866 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7c8b7761-c45d-4b61-b873-d0921af7d1b6 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:22.165367 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-da47803b-0aec-4fc0-8930-7887d71b527d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:22.166163 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-da47803b-0aec-4fc0-8930-7887d71b527d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:22.173307 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-da47803b-0aec-4fc0-8930-7887d71b527d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:22.174245 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-da47803b-0aec-4fc0-8930-7887d71b527d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:22.175079 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-da47803b-0aec-4fc0-8930-7887d71b527d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:22.175513 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-da47803b-0aec-4fc0-8930-7887d71b527d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:22.319693 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-da47803b-0aec-4fc0-8930-7887d71b527d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:22.329875 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-da47803b-0aec-4fc0-8930-7887d71b527d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:22.331813 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-da47803b-0aec-4fc0-8930-7887d71b527d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:22.333286 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-da47803b-0aec-4fc0-8930-7887d71b527d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1406 microversion: 2.20 time: 0.173921 Jul 04 04:17:22.334195 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 210/438] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:22 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:22.751243 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-141dd3e3-3ef4-4a1f-841e-c3088ec5ceb6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:22.752788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-141dd3e3-3ef4-4a1f-841e-c3088ec5ceb6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:22.760476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-141dd3e3-3ef4-4a1f-841e-c3088ec5ceb6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:22.761159 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-141dd3e3-3ef4-4a1f-841e-c3088ec5ceb6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:22.762704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-141dd3e3-3ef4-4a1f-841e-c3088ec5ceb6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:22.764768 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-141dd3e3-3ef4-4a1f-841e-c3088ec5ceb6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:23.047541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-141dd3e3-3ef4-4a1f-841e-c3088ec5ceb6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:23.048847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7c8b7761-c45d-4b61-b873-d0921af7d1b6 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "POST /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.230263 Jul 04 04:17:23.050295 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 229/439] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jul 4 04:17:21 2022] POST /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886/os-volume_attachments => generated 194 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:17:23.057617 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-141dd3e3-3ef4-4a1f-841e-c3088ec5ceb6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1509 microversion: 2.1 time: 0.311412 Jul 04 04:17:23.058257 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 211/440] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:22 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1509 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:17:23.355108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b5404903-bb3e-4eee-b319-7e1ebe33e4a0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:23.355892 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b5404903-bb3e-4eee-b319-7e1ebe33e4a0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:23.374173 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b5404903-bb3e-4eee-b319-7e1ebe33e4a0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:23.374925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b5404903-bb3e-4eee-b319-7e1ebe33e4a0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:23.375703 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b5404903-bb3e-4eee-b319-7e1ebe33e4a0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:23.376130 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b5404903-bb3e-4eee-b319-7e1ebe33e4a0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:23.606259 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b5404903-bb3e-4eee-b319-7e1ebe33e4a0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:23.617861 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b5404903-bb3e-4eee-b319-7e1ebe33e4a0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:23.620031 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b5404903-bb3e-4eee-b319-7e1ebe33e4a0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:23.621543 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b5404903-bb3e-4eee-b319-7e1ebe33e4a0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1406 microversion: 2.20 time: 0.272474 Jul 04 04:17:23.622654 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 230/441] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:23 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:24.073796 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bc2f348e-5bc3-4f3e-b2fa-a07fde12cc6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:24.074431 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bc2f348e-5bc3-4f3e-b2fa-a07fde12cc6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:24.081700 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc2f348e-5bc3-4f3e-b2fa-a07fde12cc6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:24.082311 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc2f348e-5bc3-4f3e-b2fa-a07fde12cc6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:24.084562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc2f348e-5bc3-4f3e-b2fa-a07fde12cc6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:24.085163 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc2f348e-5bc3-4f3e-b2fa-a07fde12cc6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:24.252225 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bc2f348e-5bc3-4f3e-b2fa-a07fde12cc6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:24.259818 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bc2f348e-5bc3-4f3e-b2fa-a07fde12cc6e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1509 microversion: 2.1 time: 0.189791 Jul 04 04:17:24.260400 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 212/442] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:24 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:24.641080 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a7f97893-828f-4618-96a1-dd03226e22dd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:24.641764 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a7f97893-828f-4618-96a1-dd03226e22dd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:24.648490 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a7f97893-828f-4618-96a1-dd03226e22dd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:24.648943 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a7f97893-828f-4618-96a1-dd03226e22dd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:24.649709 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a7f97893-828f-4618-96a1-dd03226e22dd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:24.650149 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a7f97893-828f-4618-96a1-dd03226e22dd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:24.807174 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a7f97893-828f-4618-96a1-dd03226e22dd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:24.815573 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a7f97893-828f-4618-96a1-dd03226e22dd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:24.817066 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a7f97893-828f-4618-96a1-dd03226e22dd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:24.818188 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a7f97893-828f-4618-96a1-dd03226e22dd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1406 microversion: 2.20 time: 0.181961 Jul 04 04:17:24.818759 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 231/443] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:24 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:25.277072 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3e6a7cd2-041e-45b5-ba03-9a7e06972f9a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:25.277861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3e6a7cd2-041e-45b5-ba03-9a7e06972f9a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:25.285273 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e6a7cd2-041e-45b5-ba03-9a7e06972f9a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:25.285720 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e6a7cd2-041e-45b5-ba03-9a7e06972f9a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:25.286520 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e6a7cd2-041e-45b5-ba03-9a7e06972f9a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:25.287126 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e6a7cd2-041e-45b5-ba03-9a7e06972f9a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:25.456193 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3e6a7cd2-041e-45b5-ba03-9a7e06972f9a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:25.467532 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3e6a7cd2-041e-45b5-ba03-9a7e06972f9a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1509 microversion: 2.1 time: 0.191121 Jul 04 04:17:25.468145 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 213/444] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:25 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1509 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:25.534874 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-8610891f-74d8-4d80-8a94-e9c08d0f4d53 req-3c34f1ef-b5b7-4ac1-a0e1-34f22b038f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e151ec-4f75-4bfe-8c27-3d6ac7c72453", "name": "network-vif-plugged", "status": "completed", "tag": "72e623a1-47a8-4ba4-ae5c-a1c4eb8869fc"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:25.545457 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-8610891f-74d8-4d80-8a94-e9c08d0f4d53 req-3c34f1ef-b5b7-4ac1-a0e1-34f22b038f9a service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:25.545912 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-8610891f-74d8-4d80-8a94-e9c08d0f4d53 req-3c34f1ef-b5b7-4ac1-a0e1-34f22b038f9a service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:25.558581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-8610891f-74d8-4d80-8a94-e9c08d0f4d53 req-3c34f1ef-b5b7-4ac1-a0e1-34f22b038f9a service nova] Creating event network-vif-plugged:72e623a1-47a8-4ba4-ae5c-a1c4eb8869fc for instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 on hv-cinder-74216 Jul 04 04:17:25.564426 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-8610891f-74d8-4d80-8a94-e9c08d0f4d53 req-3c34f1ef-b5b7-4ac1-a0e1-34f22b038f9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037020 Jul 04 04:17:25.565030 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 232/445] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:17:25.836948 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9254503d-f0e9-4137-bae7-ad4b3f8db7b8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:25.837646 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9254503d-f0e9-4137-bae7-ad4b3f8db7b8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:25.843092 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:25.845487 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9254503d-f0e9-4137-bae7-ad4b3f8db7b8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:25.846523 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9254503d-f0e9-4137-bae7-ad4b3f8db7b8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:25.848133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9254503d-f0e9-4137-bae7-ad4b3f8db7b8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:25.848843 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9254503d-f0e9-4137-bae7-ad4b3f8db7b8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:26.185698 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9254503d-f0e9-4137-bae7-ad4b3f8db7b8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:26.195242 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9254503d-f0e9-4137-bae7-ad4b3f8db7b8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:26.196884 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9254503d-f0e9-4137-bae7-ad4b3f8db7b8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:26.198078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9254503d-f0e9-4137-bae7-ad4b3f8db7b8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1406 microversion: 2.20 time: 0.365648 Jul 04 04:17:26.198638 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 214/446] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:25 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1406 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:26.486631 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e4cd5f41-272a-4ce4-b05a-e2ed6982bb0a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:26.487314 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e4cd5f41-272a-4ce4-b05a-e2ed6982bb0a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:26.494705 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4cd5f41-272a-4ce4-b05a-e2ed6982bb0a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:26.495155 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4cd5f41-272a-4ce4-b05a-e2ed6982bb0a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:26.495941 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4cd5f41-272a-4ce4-b05a-e2ed6982bb0a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:26.496374 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4cd5f41-272a-4ce4-b05a-e2ed6982bb0a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:26.641799 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e4cd5f41-272a-4ce4-b05a-e2ed6982bb0a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:26.649583 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e4cd5f41-272a-4ce4-b05a-e2ed6982bb0a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1515 microversion: 2.1 time: 0.168180 Jul 04 04:17:26.650161 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 233/447] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:26 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:27.218757 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4589b95c-2a57-4083-852d-af79257e2fa1 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:27.219346 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4589b95c-2a57-4083-852d-af79257e2fa1 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:27.226623 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4589b95c-2a57-4083-852d-af79257e2fa1 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:27.227093 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4589b95c-2a57-4083-852d-af79257e2fa1 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:27.227891 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4589b95c-2a57-4083-852d-af79257e2fa1 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:27.228343 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4589b95c-2a57-4083-852d-af79257e2fa1 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:27.601473 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4589b95c-2a57-4083-852d-af79257e2fa1 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:27.614309 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4589b95c-2a57-4083-852d-af79257e2fa1 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:27.616645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4589b95c-2a57-4083-852d-af79257e2fa1 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:27.618179 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4589b95c-2a57-4083-852d-af79257e2fa1 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1406 microversion: 2.20 time: 0.404740 Jul 04 04:17:27.619003 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 215/448] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:27 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:28.637317 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-25ee2b5f-3046-4fc1-b508-97c6ed7226b7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:28.637923 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-25ee2b5f-3046-4fc1-b508-97c6ed7226b7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:28.645786 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-25ee2b5f-3046-4fc1-b508-97c6ed7226b7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:28.646230 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-25ee2b5f-3046-4fc1-b508-97c6ed7226b7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:28.647026 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-25ee2b5f-3046-4fc1-b508-97c6ed7226b7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:28.647455 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-25ee2b5f-3046-4fc1-b508-97c6ed7226b7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:28.790228 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-25ee2b5f-3046-4fc1-b508-97c6ed7226b7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:28.802867 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-25ee2b5f-3046-4fc1-b508-97c6ed7226b7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:28.805209 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-25ee2b5f-3046-4fc1-b508-97c6ed7226b7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:28.806991 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-25ee2b5f-3046-4fc1-b508-97c6ed7226b7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1406 microversion: 2.20 time: 0.173343 Jul 04 04:17:28.807757 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 234/449] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:28 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:29.829588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-714ffe64-e943-45f5-bcee-65b55e3fe1bb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:29.830327 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-714ffe64-e943-45f5-bcee-65b55e3fe1bb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:29.838290 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-714ffe64-e943-45f5-bcee-65b55e3fe1bb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:29.838919 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-714ffe64-e943-45f5-bcee-65b55e3fe1bb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:29.839858 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-714ffe64-e943-45f5-bcee-65b55e3fe1bb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:29.840389 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-714ffe64-e943-45f5-bcee-65b55e3fe1bb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:29.988603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-714ffe64-e943-45f5-bcee-65b55e3fe1bb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:30.001416 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-714ffe64-e943-45f5-bcee-65b55e3fe1bb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:30.003341 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-714ffe64-e943-45f5-bcee-65b55e3fe1bb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:30.005078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-714ffe64-e943-45f5-bcee-65b55e3fe1bb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1406 microversion: 2.20 time: 0.181541 Jul 04 04:17:30.005823 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 216/450] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:29 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:31.025385 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-2bc7c809-5307-4e2b-80b8-085d1afd791f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:31.026047 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-2bc7c809-5307-4e2b-80b8-085d1afd791f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:31.033624 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2bc7c809-5307-4e2b-80b8-085d1afd791f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:31.034072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2bc7c809-5307-4e2b-80b8-085d1afd791f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:31.034889 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2bc7c809-5307-4e2b-80b8-085d1afd791f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:31.035327 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2bc7c809-5307-4e2b-80b8-085d1afd791f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:31.178059 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-2bc7c809-5307-4e2b-80b8-085d1afd791f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:31.186281 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-2bc7c809-5307-4e2b-80b8-085d1afd791f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:31.187805 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-2bc7c809-5307-4e2b-80b8-085d1afd791f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:31.188903 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-2bc7c809-5307-4e2b-80b8-085d1afd791f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1406 microversion: 2.20 time: 0.168045 Jul 04 04:17:31.189526 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 235/451] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:31 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:32.207717 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b1cf781f-5f55-432b-9fe9-a44da21b77f5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:32.208500 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b1cf781f-5f55-432b-9fe9-a44da21b77f5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:32.215632 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1cf781f-5f55-432b-9fe9-a44da21b77f5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:32.216212 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1cf781f-5f55-432b-9fe9-a44da21b77f5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:32.217160 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1cf781f-5f55-432b-9fe9-a44da21b77f5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:32.217626 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1cf781f-5f55-432b-9fe9-a44da21b77f5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:32.237321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-53497bae-6ab6-4f0f-bf3d-13cf883d9af3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Action: 'create', calling method: .version_select at 0x7f50c124c700>, body: {"keypair": {"name": "tempest-keypair-264423189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMq4qrG3JooOoGbDxTFc4j7agh/JdLMYJv5zYgdMMl9x2Fsjkd745hUSjmMJMYlbWl2OJwnFzAEtbcMaqsUPzbFlqlhBMwEuB6BBgs5+wdY8FysMGw3s4yqyJMnKnu0tAg=="}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:32.253007 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-53497bae-6ab6-4f0f-bf3d-13cf883d9af3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Getting quotas for project 7ea328a1154a4a9a955e411f7eab0aa9. Resources: {'key_pairs'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:17:32.256915 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-53497bae-6ab6-4f0f-bf3d-13cf883d9af3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Getting quotas for user dca54bc220104e79aa727f30399f3411 and project 7ea328a1154a4a9a955e411f7eab0aa9. Resources: {'key_pairs'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:17:32.280933 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-53497bae-6ab6-4f0f-bf3d-13cf883d9af3 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047753 Jul 04 04:17:32.281653 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 236/452] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jul 4 04:17:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:17:32.356811 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b1cf781f-5f55-432b-9fe9-a44da21b77f5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:32.365436 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b1cf781f-5f55-432b-9fe9-a44da21b77f5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:32.367113 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b1cf781f-5f55-432b-9fe9-a44da21b77f5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:32.368366 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b1cf781f-5f55-432b-9fe9-a44da21b77f5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1406 microversion: 2.20 time: 0.164735 Jul 04 04:17:32.368999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 217/453] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:32 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:33.388410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-82388e86-9775-41bf-b640-1cada4e82e3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:33.389390 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-82388e86-9775-41bf-b640-1cada4e82e3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:33.396831 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-82388e86-9775-41bf-b640-1cada4e82e3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:33.397255 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-82388e86-9775-41bf-b640-1cada4e82e3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:33.398062 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-82388e86-9775-41bf-b640-1cada4e82e3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:33.398821 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-82388e86-9775-41bf-b640-1cada4e82e3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:33.605178 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-82388e86-9775-41bf-b640-1cada4e82e3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:33.614547 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-82388e86-9775-41bf-b640-1cada4e82e3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:33.616062 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-82388e86-9775-41bf-b640-1cada4e82e3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:33.617438 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-82388e86-9775-41bf-b640-1cada4e82e3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1406 microversion: 2.20 time: 0.233788 Jul 04 04:17:33.617992 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 237/454] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:33 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:33.693784 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a2f31fd0-2c51-4f49-a439-32d78e3fcf53 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-423843234", "imageRef": "46b9937d-f997-401a-a3aa-bb9028764454", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b852890-6d40-459d-8b3f-cc97ada90f12"}], "security_groups": [{"name": "tempest-securitygroup--2078301621"}], "key_name": "tempest-keypair-264423189", "user_data": "}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:33.813724 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-a2f31fd0-2c51-4f49-a439-32d78e3fcf53 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] validate_networks() for [('6b852890-6d40-459d-8b3f-cc97ada90f12', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:17:34.203717 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-a2f31fd0-2c51-4f49-a439-32d78e3fcf53 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:17:34.204355 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-a2f31fd0-2c51-4f49-a439-32d78e3fcf53 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:17:34.204829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-a2f31fd0-2c51-4f49-a439-32d78e3fcf53 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:17:34.205368 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-a2f31fd0-2c51-4f49-a439-32d78e3fcf53 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:17:34.205781 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-a2f31fd0-2c51-4f49-a439-32d78e3fcf53 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:17:34.219522 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2f31fd0-2c51-4f49-a439-32d78e3fcf53 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:34.219968 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2f31fd0-2c51-4f49-a439-32d78e3fcf53 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:34.220765 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2f31fd0-2c51-4f49-a439-32d78e3fcf53 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:34.221199 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a2f31fd0-2c51-4f49-a439-32d78e3fcf53 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:34.238463 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-a2f31fd0-2c51-4f49-a439-32d78e3fcf53 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Getting quotas for project 7ea328a1154a4a9a955e411f7eab0aa9. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:17:34.242901 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-a2f31fd0-2c51-4f49-a439-32d78e3fcf53 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Getting quotas for user dca54bc220104e79aa727f30399f3411 and project 7ea328a1154a4a9a955e411f7eab0aa9. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:17:34.254558 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a2f31fd0-2c51-4f49-a439-32d78e3fcf53 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:17:34.256811 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a2f31fd0-2c51-4f49-a439-32d78e3fcf53 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46b9937d-f997-401a-a3aa-bb9028764454',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:17:34.303916 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a2f31fd0-2c51-4f49-a439-32d78e3fcf53 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.616776 Jul 04 04:17:34.304563 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 218/455] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:17:33 2022] POST /compute/v2.1/servers => generated 409 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 04:17:34.314720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-2c05001d-dd69-4b94-a387-30ae374615c6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:34.315327 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-2c05001d-dd69-4b94-a387-30ae374615c6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:34.317343 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:34.374633 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-2c05001d-dd69-4b94-a387-30ae374615c6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:34.381825 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-2c05001d-dd69-4b94-a387-30ae374615c6 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1244 microversion: 2.1 time: 0.071161 Jul 04 04:17:34.382427 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 238/456] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:34 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1244 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:34.636365 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4cdd058c-a35f-4d3f-a9b8-2b57b4932af3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:34.636987 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4cdd058c-a35f-4d3f-a9b8-2b57b4932af3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:34.639355 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:34.646907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cdd058c-a35f-4d3f-a9b8-2b57b4932af3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:34.647397 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cdd058c-a35f-4d3f-a9b8-2b57b4932af3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:34.648222 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cdd058c-a35f-4d3f-a9b8-2b57b4932af3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:34.648703 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cdd058c-a35f-4d3f-a9b8-2b57b4932af3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:34.787643 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4cdd058c-a35f-4d3f-a9b8-2b57b4932af3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:34.795945 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4cdd058c-a35f-4d3f-a9b8-2b57b4932af3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:34.797551 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4cdd058c-a35f-4d3f-a9b8-2b57b4932af3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:34.798708 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4cdd058c-a35f-4d3f-a9b8-2b57b4932af3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1406 microversion: 2.20 time: 0.166838 Jul 04 04:17:34.799276 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 219/457] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:34 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:35.403587 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-08f9ec41-1b62-4306-93f7-f60d3eecda2f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:35.404479 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-08f9ec41-1b62-4306-93f7-f60d3eecda2f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:35.415749 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-08f9ec41-1b62-4306-93f7-f60d3eecda2f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:35.416440 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-08f9ec41-1b62-4306-93f7-f60d3eecda2f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:35.417676 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-08f9ec41-1b62-4306-93f7-f60d3eecda2f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:35.418356 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-08f9ec41-1b62-4306-93f7-f60d3eecda2f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:35.484280 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-08f9ec41-1b62-4306-93f7-f60d3eecda2f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:35.492188 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-08f9ec41-1b62-4306-93f7-f60d3eecda2f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1248 microversion: 2.1 time: 0.095272 Jul 04 04:17:35.492778 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 239/458] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:35 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1248 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:35.820099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-59140627-5b89-4c39-b382-46107cdff77b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:35.821174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-59140627-5b89-4c39-b382-46107cdff77b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:35.831008 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-59140627-5b89-4c39-b382-46107cdff77b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:35.831665 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-59140627-5b89-4c39-b382-46107cdff77b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:35.832758 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-59140627-5b89-4c39-b382-46107cdff77b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:35.833374 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-59140627-5b89-4c39-b382-46107cdff77b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:35.989754 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-59140627-5b89-4c39-b382-46107cdff77b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:35.997853 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-59140627-5b89-4c39-b382-46107cdff77b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:35.999359 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-59140627-5b89-4c39-b382-46107cdff77b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:36.000497 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-59140627-5b89-4c39-b382-46107cdff77b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1406 microversion: 2.20 time: 0.185756 Jul 04 04:17:36.001052 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 220/459] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:35 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:36.509132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a6827d43-9d24-463d-abc3-9674085aa7f5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:36.509830 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a6827d43-9d24-463d-abc3-9674085aa7f5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:36.517732 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a6827d43-9d24-463d-abc3-9674085aa7f5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:36.518186 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a6827d43-9d24-463d-abc3-9674085aa7f5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:36.519009 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a6827d43-9d24-463d-abc3-9674085aa7f5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:36.519447 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a6827d43-9d24-463d-abc3-9674085aa7f5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:36.586829 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a6827d43-9d24-463d-abc3-9674085aa7f5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:36.595132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a6827d43-9d24-463d-abc3-9674085aa7f5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1248 microversion: 2.1 time: 0.089882 Jul 04 04:17:36.595701 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 240/460] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:36 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1248 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:37.019174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d3c3442f-7b25-47fe-9d2f-e57aff40d56a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:37.019770 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d3c3442f-7b25-47fe-9d2f-e57aff40d56a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:37.027218 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3c3442f-7b25-47fe-9d2f-e57aff40d56a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:37.027670 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3c3442f-7b25-47fe-9d2f-e57aff40d56a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:37.028435 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3c3442f-7b25-47fe-9d2f-e57aff40d56a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:37.028868 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3c3442f-7b25-47fe-9d2f-e57aff40d56a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:37.031568 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:37.181083 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d3c3442f-7b25-47fe-9d2f-e57aff40d56a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:37.192552 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d3c3442f-7b25-47fe-9d2f-e57aff40d56a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:37.194047 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d3c3442f-7b25-47fe-9d2f-e57aff40d56a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:37.195239 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d3c3442f-7b25-47fe-9d2f-e57aff40d56a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1597 microversion: 2.20 time: 0.180317 Jul 04 04:17:37.195811 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 221/461] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:17:37 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1597 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:17:37.213194 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-bb8d3cd5-dff5-43fa-a5dd-4162e0c210d0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:37.213678 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-bb8d3cd5-dff5-43fa-a5dd-4162e0c210d0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:37.220178 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bb8d3cd5-dff5-43fa-a5dd-4162e0c210d0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:37.220626 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bb8d3cd5-dff5-43fa-a5dd-4162e0c210d0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:37.221371 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bb8d3cd5-dff5-43fa-a5dd-4162e0c210d0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:37.221795 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bb8d3cd5-dff5-43fa-a5dd-4162e0c210d0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:37.299792 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-bb8d3cd5-dff5-43fa-a5dd-4162e0c210d0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090481 Jul 04 04:17:37.300427 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 241/462] 10.222.0.16 () {60 vars in 1315 bytes} [Mon Jul 4 04:17:37 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:17:37.614407 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-427041dd-6cd8-4563-b3c9-ce5e1dbc080e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:37.615814 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-427041dd-6cd8-4563-b3c9-ce5e1dbc080e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:37.623199 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-427041dd-6cd8-4563-b3c9-ce5e1dbc080e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:37.623648 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-427041dd-6cd8-4563-b3c9-ce5e1dbc080e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:37.624432 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-427041dd-6cd8-4563-b3c9-ce5e1dbc080e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:37.624866 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-427041dd-6cd8-4563-b3c9-ce5e1dbc080e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:37.717366 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-427041dd-6cd8-4563-b3c9-ce5e1dbc080e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:37.727251 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-427041dd-6cd8-4563-b3c9-ce5e1dbc080e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1240 microversion: 2.1 time: 0.118438 Jul 04 04:17:37.731326 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 222/463] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:37 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1240 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:38.130401 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-6e18fe03-44fa-4dab-8e5b-f30d356c9f23 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:38.131049 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-6e18fe03-44fa-4dab-8e5b-f30d356c9f23 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:38.137372 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6e18fe03-44fa-4dab-8e5b-f30d356c9f23 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:38.137817 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6e18fe03-44fa-4dab-8e5b-f30d356c9f23 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:38.139053 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6e18fe03-44fa-4dab-8e5b-f30d356c9f23 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:38.139485 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6e18fe03-44fa-4dab-8e5b-f30d356c9f23 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:38.574654 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-6e18fe03-44fa-4dab-8e5b-f30d356c9f23 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:38.583752 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-6e18fe03-44fa-4dab-8e5b-f30d356c9f23 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1590 microversion: 2.1 time: 0.458523 Jul 04 04:17:38.584385 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 242/464] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:38 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1590 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:38.639070 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-9b92c2bd-cc5e-4792-97e7-39335bea3ec2 req-4451781d-24f3-4def-a71b-13388b47b2bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6e151ec-4f75-4bfe-8c27-3d6ac7c72453", "tag": "72e623a1-47a8-4ba4-ae5c-a1c4eb8869fc"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:38.648577 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-9b92c2bd-cc5e-4792-97e7-39335bea3ec2 req-4451781d-24f3-4def-a71b-13388b47b2bf service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:38.649164 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-9b92c2bd-cc5e-4792-97e7-39335bea3ec2 req-4451781d-24f3-4def-a71b-13388b47b2bf service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:38.663032 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-9b92c2bd-cc5e-4792-97e7-39335bea3ec2 req-4451781d-24f3-4def-a71b-13388b47b2bf service nova] Creating event network-changed:72e623a1-47a8-4ba4-ae5c-a1c4eb8869fc for instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 on hv-cinder-74216 Jul 04 04:17:38.668675 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-9b92c2bd-cc5e-4792-97e7-39335bea3ec2 req-4451781d-24f3-4def-a71b-13388b47b2bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034305 Jul 04 04:17:38.669666 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 223/465] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:17:38.748391 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-639bf217-8c99-4dd5-a228-539625979f43 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:38.749006 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-639bf217-8c99-4dd5-a228-539625979f43 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:38.755455 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-639bf217-8c99-4dd5-a228-539625979f43 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:38.755904 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-639bf217-8c99-4dd5-a228-539625979f43 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:38.756676 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-639bf217-8c99-4dd5-a228-539625979f43 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:38.757106 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-639bf217-8c99-4dd5-a228-539625979f43 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:38.827568 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-639bf217-8c99-4dd5-a228-539625979f43 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:38.836200 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-639bf217-8c99-4dd5-a228-539625979f43 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1296 microversion: 2.1 time: 0.091917 Jul 04 04:17:38.836871 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 243/466] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:38 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:39.854683 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8b69aacd-aef5-4f30-a64f-2ecd539d7b42 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:39.855469 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8b69aacd-aef5-4f30-a64f-2ecd539d7b42 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:39.868107 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b69aacd-aef5-4f30-a64f-2ecd539d7b42 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:39.868740 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b69aacd-aef5-4f30-a64f-2ecd539d7b42 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:39.869657 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b69aacd-aef5-4f30-a64f-2ecd539d7b42 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:39.870341 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b69aacd-aef5-4f30-a64f-2ecd539d7b42 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:39.952453 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8b69aacd-aef5-4f30-a64f-2ecd539d7b42 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:39.960730 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8b69aacd-aef5-4f30-a64f-2ecd539d7b42 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1296 microversion: 2.1 time: 0.111302 Jul 04 04:17:39.961328 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 224/467] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:39 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1296 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:40.688499 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-2482c043-71db-4a2f-bb7f-56c6f4bb2cd4 req-fa4dac27-9a1a-416d-93af-6c0e616e0560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb07e282-565d-4780-b4e0-9fcc76ac5886", "tag": "824e9a73-e83d-443e-a6cb-c8627c01096f"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:40.699590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-2482c043-71db-4a2f-bb7f-56c6f4bb2cd4 req-fa4dac27-9a1a-416d-93af-6c0e616e0560 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:40.700303 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-2482c043-71db-4a2f-bb7f-56c6f4bb2cd4 req-fa4dac27-9a1a-416d-93af-6c0e616e0560 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:40.707123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:40.721284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-2482c043-71db-4a2f-bb7f-56c6f4bb2cd4 req-fa4dac27-9a1a-416d-93af-6c0e616e0560 service nova] Creating event network-changed:824e9a73-e83d-443e-a6cb-c8627c01096f for instance fb07e282-565d-4780-b4e0-9fcc76ac5886 on hv-cinder-74216 Jul 04 04:17:40.738811 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-2482c043-71db-4a2f-bb7f-56c6f4bb2cd4 req-fa4dac27-9a1a-416d-93af-6c0e616e0560 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054408 Jul 04 04:17:40.739808 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 244/468] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:17:40.977690 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-036e9892-7574-4676-8704-44d4240ddf70 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:40.978296 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-036e9892-7574-4676-8704-44d4240ddf70 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:40.986361 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-036e9892-7574-4676-8704-44d4240ddf70 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:40.987103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-036e9892-7574-4676-8704-44d4240ddf70 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:40.988028 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-036e9892-7574-4676-8704-44d4240ddf70 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:40.988569 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-036e9892-7574-4676-8704-44d4240ddf70 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:41.069049 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-036e9892-7574-4676-8704-44d4240ddf70 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:41.078417 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-036e9892-7574-4676-8704-44d4240ddf70 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1296 microversion: 2.1 time: 0.104099 Jul 04 04:17:41.082788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 225/469] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:40 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1296 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:41.524043 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-eda6fc87-9cf9-41cc-846c-4c0b635c793b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-642876144"}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:41.524679 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-eda6fc87-9cf9-41cc-846c-4c0b635c793b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:41.532608 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-eda6fc87-9cf9-41cc-846c-4c0b635c793b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:41.532608 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-eda6fc87-9cf9-41cc-846c-4c0b635c793b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:41.533243 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-eda6fc87-9cf9-41cc-846c-4c0b635c793b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:41.533674 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-eda6fc87-9cf9-41cc-846c-4c0b635c793b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:41.692521 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.network.security_group_api [None req-eda6fc87-9cf9-41cc-846c-4c0b635c793b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Adding security group cbd67096-6283-4aaf-9ea3-be44bec82ce8 to port 824e9a73-e83d-443e-a6cb-c8627c01096f Jul 04 04:17:42.084753 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-eda6fc87-9cf9-41cc-846c-4c0b635c793b tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "POST /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886/action" status: 202 len: 0 microversion: 2.1 time: 0.564930 Jul 04 04:17:42.086772 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 245/470] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 4 04:17:41 2022] POST /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:17:42.096106 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-44bb1eda-29b0-4eed-87b2-64f593f36eba tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:42.097007 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-44bb1eda-29b0-4eed-87b2-64f593f36eba tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:42.098274 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3d0940f6-d998-4df3-a9ab-5aaef353e352 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:42.099268 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-3d0940f6-d998-4df3-a9ab-5aaef353e352 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:42.104889 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44bb1eda-29b0-4eed-87b2-64f593f36eba tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:42.105443 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44bb1eda-29b0-4eed-87b2-64f593f36eba tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:42.106360 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44bb1eda-29b0-4eed-87b2-64f593f36eba tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:42.106926 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44bb1eda-29b0-4eed-87b2-64f593f36eba tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:42.107154 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3d0940f6-d998-4df3-a9ab-5aaef353e352 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:42.107608 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3d0940f6-d998-4df3-a9ab-5aaef353e352 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:42.108403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3d0940f6-d998-4df3-a9ab-5aaef353e352 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:42.108983 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3d0940f6-d998-4df3-a9ab-5aaef353e352 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:42.196691 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-3d0940f6-d998-4df3-a9ab-5aaef353e352 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:42.206564 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3d0940f6-d998-4df3-a9ab-5aaef353e352 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1296 microversion: 2.1 time: 0.114562 Jul 04 04:17:42.207150 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 246/471] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:42 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1296 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:42.511678 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-44bb1eda-29b0-4eed-87b2-64f593f36eba tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:42.521063 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-44bb1eda-29b0-4eed-87b2-64f593f36eba tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1636 microversion: 2.1 time: 0.430284 Jul 04 04:17:42.522205 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 226/472] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:42 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1636 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:42.753970 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-bbccd60b-2eef-45f8-88ab-2dafea82514f req-637f5e19-a85f-4ecd-9af4-0816d70851a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb07e282-565d-4780-b4e0-9fcc76ac5886", "tag": "824e9a73-e83d-443e-a6cb-c8627c01096f"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:42.762923 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-bbccd60b-2eef-45f8-88ab-2dafea82514f req-637f5e19-a85f-4ecd-9af4-0816d70851a4 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:42.763501 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-bbccd60b-2eef-45f8-88ab-2dafea82514f req-637f5e19-a85f-4ecd-9af4-0816d70851a4 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:42.776068 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-bbccd60b-2eef-45f8-88ab-2dafea82514f req-637f5e19-a85f-4ecd-9af4-0816d70851a4 service nova] Creating event network-changed:824e9a73-e83d-443e-a6cb-c8627c01096f for instance fb07e282-565d-4780-b4e0-9fcc76ac5886 on hv-cinder-74216 Jul 04 04:17:42.781710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-bbccd60b-2eef-45f8-88ab-2dafea82514f req-637f5e19-a85f-4ecd-9af4-0816d70851a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032230 Jul 04 04:17:42.782706 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 247/473] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:17:43.224303 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-37e00111-e461-4da6-b0e2-de9160b11f6d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:43.225047 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-37e00111-e461-4da6-b0e2-de9160b11f6d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:43.231920 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37e00111-e461-4da6-b0e2-de9160b11f6d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:43.232618 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37e00111-e461-4da6-b0e2-de9160b11f6d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:43.233593 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37e00111-e461-4da6-b0e2-de9160b11f6d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:43.234127 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37e00111-e461-4da6-b0e2-de9160b11f6d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:43.372294 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-37e00111-e461-4da6-b0e2-de9160b11f6d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:43.382114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-37e00111-e461-4da6-b0e2-de9160b11f6d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1302 microversion: 2.1 time: 0.161648 Jul 04 04:17:43.382923 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 227/474] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:43 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1302 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:44.398950 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=6 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:44.408238 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-8ee96bf2-169f-4dca-b8f8-c5651207789f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:44.409877 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-8ee96bf2-169f-4dca-b8f8-c5651207789f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:44.418873 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8ee96bf2-169f-4dca-b8f8-c5651207789f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:44.433557 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8ee96bf2-169f-4dca-b8f8-c5651207789f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:44.435228 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8ee96bf2-169f-4dca-b8f8-c5651207789f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:44.435736 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8ee96bf2-169f-4dca-b8f8-c5651207789f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:44.606064 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-8ee96bf2-169f-4dca-b8f8-c5651207789f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:44.613082 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-8ee96bf2-169f-4dca-b8f8-c5651207789f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1370 microversion: 2.1 time: 0.215612 Jul 04 04:17:44.613651 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 248/475] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:44 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:17:44.801971 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-ef5e8a3d-2eeb-424f-8c20-cdd6e1142220 req-62b99c44-e00f-428a-bebf-2be6b9ffbf26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfaa8d9e-b400-45d9-a635-3916ec760c32", "tag": "e37866cf-542d-489f-93a0-a1d504eaec14"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:44.807703 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:44.809530 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=6 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:44.817720 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ef5e8a3d-2eeb-424f-8c20-cdd6e1142220 req-62b99c44-e00f-428a-bebf-2be6b9ffbf26 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:44.818169 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ef5e8a3d-2eeb-424f-8c20-cdd6e1142220 req-62b99c44-e00f-428a-bebf-2be6b9ffbf26 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:44.829525 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-ef5e8a3d-2eeb-424f-8c20-cdd6e1142220 req-62b99c44-e00f-428a-bebf-2be6b9ffbf26 service nova] Creating event network-changed:e37866cf-542d-489f-93a0-a1d504eaec14 for instance cfaa8d9e-b400-45d9-a635-3916ec760c32 on hv-cinder-74216 Jul 04 04:17:44.834627 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-ef5e8a3d-2eeb-424f-8c20-cdd6e1142220 req-62b99c44-e00f-428a-bebf-2be6b9ffbf26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038728 Jul 04 04:17:44.835204 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 228/476] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:17:45.630680 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-04259861-6ee5-47e1-a6e9-7e1c9b8c3a12 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:45.631371 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-04259861-6ee5-47e1-a6e9-7e1c9b8c3a12 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:45.638273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-04259861-6ee5-47e1-a6e9-7e1c9b8c3a12 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:45.639082 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-04259861-6ee5-47e1-a6e9-7e1c9b8c3a12 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:45.639850 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-04259861-6ee5-47e1-a6e9-7e1c9b8c3a12 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:45.640282 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-04259861-6ee5-47e1-a6e9-7e1c9b8c3a12 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:45.773240 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-04259861-6ee5-47e1-a6e9-7e1c9b8c3a12 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:45.781025 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-04259861-6ee5-47e1-a6e9-7e1c9b8c3a12 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1370 microversion: 2.1 time: 0.154327 Jul 04 04:17:45.781570 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 249/477] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:45 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:46.803229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-70993c90-7f48-4637-ab44-936d8677a575 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:46.804080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-70993c90-7f48-4637-ab44-936d8677a575 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:46.811899 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70993c90-7f48-4637-ab44-936d8677a575 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:46.812429 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70993c90-7f48-4637-ab44-936d8677a575 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:46.813338 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70993c90-7f48-4637-ab44-936d8677a575 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:46.814411 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70993c90-7f48-4637-ab44-936d8677a575 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:46.958235 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-70993c90-7f48-4637-ab44-936d8677a575 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:46.965086 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-70993c90-7f48-4637-ab44-936d8677a575 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1370 microversion: 2.1 time: 0.168793 Jul 04 04:17:46.965666 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 229/478] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:46 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:47.987885 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-29a1cd66-6d94-409a-aa37-040a538a09ac tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:47.988723 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-29a1cd66-6d94-409a-aa37-040a538a09ac tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:48.000942 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-29a1cd66-6d94-409a-aa37-040a538a09ac tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:48.001692 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-29a1cd66-6d94-409a-aa37-040a538a09ac tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:48.003082 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-29a1cd66-6d94-409a-aa37-040a538a09ac tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:48.003978 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-29a1cd66-6d94-409a-aa37-040a538a09ac tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:48.149123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-29a1cd66-6d94-409a-aa37-040a538a09ac tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:48.156792 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-29a1cd66-6d94-409a-aa37-040a538a09ac tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1370 microversion: 2.1 time: 0.176300 Jul 04 04:17:48.166124 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 250/479] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:47 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:49.173084 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f54b85b9-b4f3-47b3-80d1-d32c66475434 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:49.173897 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f54b85b9-b4f3-47b3-80d1-d32c66475434 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:49.180464 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f54b85b9-b4f3-47b3-80d1-d32c66475434 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:49.180915 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f54b85b9-b4f3-47b3-80d1-d32c66475434 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:49.181683 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f54b85b9-b4f3-47b3-80d1-d32c66475434 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:49.182115 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f54b85b9-b4f3-47b3-80d1-d32c66475434 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:49.314477 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f54b85b9-b4f3-47b3-80d1-d32c66475434 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:49.321990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f54b85b9-b4f3-47b3-80d1-d32c66475434 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1370 microversion: 2.1 time: 0.152875 Jul 04 04:17:49.322590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 230/480] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:49 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:50.341168 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-953d8531-4405-462c-9d57-8342af9d0b28 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:50.342657 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-953d8531-4405-462c-9d57-8342af9d0b28 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:50.349614 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-953d8531-4405-462c-9d57-8342af9d0b28 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:50.350087 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-953d8531-4405-462c-9d57-8342af9d0b28 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:50.350898 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-953d8531-4405-462c-9d57-8342af9d0b28 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:50.351309 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-953d8531-4405-462c-9d57-8342af9d0b28 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:50.499256 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-953d8531-4405-462c-9d57-8342af9d0b28 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:50.507667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-953d8531-4405-462c-9d57-8342af9d0b28 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1370 microversion: 2.1 time: 0.170380 Jul 04 04:17:50.508257 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 251/481] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:50 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:51.006180 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-329d0d92-1a83-4ac4-b698-7ba0948635a1 req-ba9d7fb5-54e5-481b-a6eb-0b00eb684e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfaa8d9e-b400-45d9-a635-3916ec760c32", "name": "network-vif-plugged", "status": "completed", "tag": "e37866cf-542d-489f-93a0-a1d504eaec14"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:51.015479 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-329d0d92-1a83-4ac4-b698-7ba0948635a1 req-ba9d7fb5-54e5-481b-a6eb-0b00eb684e4a service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:51.017308 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-329d0d92-1a83-4ac4-b698-7ba0948635a1 req-ba9d7fb5-54e5-481b-a6eb-0b00eb684e4a service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:51.030052 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-329d0d92-1a83-4ac4-b698-7ba0948635a1 req-ba9d7fb5-54e5-481b-a6eb-0b00eb684e4a service nova] Creating event network-vif-plugged:e37866cf-542d-489f-93a0-a1d504eaec14 for instance cfaa8d9e-b400-45d9-a635-3916ec760c32 on hv-cinder-74216 Jul 04 04:17:51.035427 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-329d0d92-1a83-4ac4-b698-7ba0948635a1 req-ba9d7fb5-54e5-481b-a6eb-0b00eb684e4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033266 Jul 04 04:17:51.036079 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 231/482] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:17:51.525231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ecc9d107-55a8-499b-93cb-b23df890e06c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:51.527174 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-ecc9d107-55a8-499b-93cb-b23df890e06c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:51.544038 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ecc9d107-55a8-499b-93cb-b23df890e06c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:51.544731 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ecc9d107-55a8-499b-93cb-b23df890e06c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:51.549347 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ecc9d107-55a8-499b-93cb-b23df890e06c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:51.549988 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ecc9d107-55a8-499b-93cb-b23df890e06c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:51.711987 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-ecc9d107-55a8-499b-93cb-b23df890e06c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:51.719638 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ecc9d107-55a8-499b-93cb-b23df890e06c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1370 microversion: 2.1 time: 0.198398 Jul 04 04:17:51.720202 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 252/483] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:51 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:52.756884 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-244b6a20-4356-4b2b-9b98-5520bf5f452c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:52.759470 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-244b6a20-4356-4b2b-9b98-5520bf5f452c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:52.770128 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-244b6a20-4356-4b2b-9b98-5520bf5f452c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:52.770919 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-244b6a20-4356-4b2b-9b98-5520bf5f452c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:52.771901 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-244b6a20-4356-4b2b-9b98-5520bf5f452c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:52.772926 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-244b6a20-4356-4b2b-9b98-5520bf5f452c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:53.008786 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-244b6a20-4356-4b2b-9b98-5520bf5f452c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:53.028590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-244b6a20-4356-4b2b-9b98-5520bf5f452c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1370 microversion: 2.1 time: 0.295050 Jul 04 04:17:53.042640 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 232/484] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:52 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1370 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:54.050656 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-acf72a66-7371-4ef9-872b-48546be2c5ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:54.051345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-acf72a66-7371-4ef9-872b-48546be2c5ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:54.057928 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-acf72a66-7371-4ef9-872b-48546be2c5ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:54.059208 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-acf72a66-7371-4ef9-872b-48546be2c5ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:54.060533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-acf72a66-7371-4ef9-872b-48546be2c5ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:54.061126 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-acf72a66-7371-4ef9-872b-48546be2c5ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:54.204255 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-acf72a66-7371-4ef9-872b-48546be2c5ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:17:54.213798 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-acf72a66-7371-4ef9-872b-48546be2c5ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1564 microversion: 2.1 time: 0.167177 Jul 04 04:17:54.226251 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 253/485] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:17:54 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1564 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:17:54.231728 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f8466fbd-d19e-4b3e-a609-35bbc9d66ce4 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:17:54.232378 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f8466fbd-d19e-4b3e-a609-35bbc9d66ce4 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:17:54.239873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8466fbd-d19e-4b3e-a609-35bbc9d66ce4 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:54.240390 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8466fbd-d19e-4b3e-a609-35bbc9d66ce4 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:54.241272 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8466fbd-d19e-4b3e-a609-35bbc9d66ce4 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:54.241771 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8466fbd-d19e-4b3e-a609-35bbc9d66ce4 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:54.333248 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f8466fbd-d19e-4b3e-a609-35bbc9d66ce4 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105792 Jul 04 04:17:54.333997 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 233/486] 10.222.0.16 () {58 vars in 1274 bytes} [Mon Jul 4 04:17:54 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:17:55.685379 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-3e4b91be-cf83-46d8-8812-a2bdbacd217c req-9c26f427-3e8d-4219-a9cb-30655f784f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfaa8d9e-b400-45d9-a635-3916ec760c32", "tag": "e37866cf-542d-489f-93a0-a1d504eaec14"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:55.698334 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-3e4b91be-cf83-46d8-8812-a2bdbacd217c req-9c26f427-3e8d-4219-a9cb-30655f784f47 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:17:55.699519 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-3e4b91be-cf83-46d8-8812-a2bdbacd217c req-9c26f427-3e8d-4219-a9cb-30655f784f47 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:17:55.713682 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-3e4b91be-cf83-46d8-8812-a2bdbacd217c req-9c26f427-3e8d-4219-a9cb-30655f784f47 service nova] Creating event network-changed:e37866cf-542d-489f-93a0-a1d504eaec14 for instance cfaa8d9e-b400-45d9-a635-3916ec760c32 on hv-cinder-74216 Jul 04 04:17:55.721524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-3e4b91be-cf83-46d8-8812-a2bdbacd217c req-9c26f427-3e8d-4219-a9cb-30655f784f47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045630 Jul 04 04:17:55.722716 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 254/487] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:17:59.791295 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-054422b5-5ff6-4a6d-9f73-2255d80d369e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Action: 'create', calling method: .version_select at 0x7f50c10d5820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1321978684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFM8tUwRKx+AHzruWnZ/s4GaE3Wm4p6QeMeZZuQhqfhBDg1GYCyXCETM67LOty7Q4YMx+bg8eEltw0qqcSgwQi6o8+FYMHAfVKU/+KAY7dmHjKzdmqD22ggiZP/Yd4MYPA=="}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:17:59.806675 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-054422b5-5ff6-4a6d-9f73-2255d80d369e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Getting quotas for project b622ab692a73432784c63b9ad3290e72. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:17:59.810897 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-054422b5-5ff6-4a6d-9f73-2255d80d369e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Getting quotas for user 34ec54486c9d404896f832b87f99bc11 and project b622ab692a73432784c63b9ad3290e72. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:17:59.837154 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-054422b5-5ff6-4a6d-9f73-2255d80d369e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.256188 Jul 04 04:17:59.837766 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 234/488] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jul 4 04:17:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:18:25.688030 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=35 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:25.688778 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=50 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:25.693122 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-34da3dda-9507-4be4-85f6-06020682c489 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-421748214", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1321978684", "security_groups": [{"name": "tempest-secgroup-smoke-122465126"}], "block_device_mapping_v2": [{"uuid": "937b9b32-def2-45ed-8629-ac9a9cd5e3af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1d07c9ba-9977-4c1a-95be-b18ead1c7da1"}]}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:18:25.723641 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=63 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:25.724584 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:25.725501 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:25.729885 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bea5dfd8-ec82-4acf-8f07-ade129ccdf1b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:25.730466 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bea5dfd8-ec82-4acf-8f07-ade129ccdf1b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:25.739398 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bea5dfd8-ec82-4acf-8f07-ade129ccdf1b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:25.739868 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bea5dfd8-ec82-4acf-8f07-ade129ccdf1b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:25.740735 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bea5dfd8-ec82-4acf-8f07-ade129ccdf1b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:25.741166 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bea5dfd8-ec82-4acf-8f07-ade129ccdf1b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:25.765239 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bea5dfd8-ec82-4acf-8f07-ade129ccdf1b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12/ips" status: 200 len: 150 microversion: 2.1 time: 0.043190 Jul 04 04:18:25.765818 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 235/489] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jul 4 04:18:25 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:18:25.810015 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.network.neutron [None req-34da3dda-9507-4be4-85f6-06020682c489 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] validate_networks() for [('1d07c9ba-9977-4c1a-95be-b18ead1c7da1', None, None, None, None, None)] {{(pid=117875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:18:26.220158 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-34da3dda-9507-4be4-85f6-06020682c489 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Flavor limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:18:26.220583 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-34da3dda-9507-4be4-85f6-06020682c489 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Image limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:18:26.221051 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-34da3dda-9507-4be4-85f6-06020682c489 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Flavor pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:18:26.221452 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-34da3dda-9507-4be4-85f6-06020682c489 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Image pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:18:26.221859 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-34da3dda-9507-4be4-85f6-06020682c489 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:18:26.231699 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-34da3dda-9507-4be4-85f6-06020682c489 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:26.232170 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-34da3dda-9507-4be4-85f6-06020682c489 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:26.232962 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-34da3dda-9507-4be4-85f6-06020682c489 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:26.233396 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-34da3dda-9507-4be4-85f6-06020682c489 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:26.252284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-34da3dda-9507-4be4-85f6-06020682c489 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Getting quotas for project b622ab692a73432784c63b9ad3290e72. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:18:26.257009 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-34da3dda-9507-4be4-85f6-06020682c489 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Getting quotas for user 34ec54486c9d404896f832b87f99bc11 and project b622ab692a73432784c63b9ad3290e72. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:18:26.315971 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-34da3dda-9507-4be4-85f6-06020682c489 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Going to run 1 instances... {{(pid=117875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:18:26.318219 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-34da3dda-9507-4be4-85f6-06020682c489 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='937b9b32-def2-45ed-8629-ac9a9cd5e3af',volume_size=None,volume_type=None)] {{(pid=117875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:18:26.449723 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-34da3dda-9507-4be4-85f6-06020682c489 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.763357 Jul 04 04:18:26.450358 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 255/490] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:18:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 04:18:26.460525 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e33ff411-2881-4d33-b66c-5963ecd4fd2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:26.461391 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e33ff411-2881-4d33-b66c-5963ecd4fd2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:26.516378 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e33ff411-2881-4d33-b66c-5963ecd4fd2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:26.524143 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e33ff411-2881-4d33-b66c-5963ecd4fd2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1094 microversion: 2.1 time: 0.066851 Jul 04 04:18:26.524724 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 236/491] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:26 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:27.132102 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-0a25b6d4-278e-4220-96eb-f8e790cdd9c5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e5a697f-11b5-496c-84ab-99ad2f03a698"}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:18:27.133277 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-0a25b6d4-278e-4220-96eb-f8e790cdd9c5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:27.140861 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0a25b6d4-278e-4220-96eb-f8e790cdd9c5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:27.141308 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0a25b6d4-278e-4220-96eb-f8e790cdd9c5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:27.142064 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0a25b6d4-278e-4220-96eb-f8e790cdd9c5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:27.142523 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0a25b6d4-278e-4220-96eb-f8e790cdd9c5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:27.543992 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-51dfd9a9-a8da-403c-abda-046d303e476b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:27.544817 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-51dfd9a9-a8da-403c-abda-046d303e476b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:27.553811 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51dfd9a9-a8da-403c-abda-046d303e476b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:27.554653 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51dfd9a9-a8da-403c-abda-046d303e476b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:27.555712 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51dfd9a9-a8da-403c-abda-046d303e476b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:27.556303 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51dfd9a9-a8da-403c-abda-046d303e476b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:27.613509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-0a25b6d4-278e-4220-96eb-f8e790cdd9c5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "POST /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.485847 Jul 04 04:18:27.614123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 256/492] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jul 4 04:18:27 2022] POST /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12/os-volume_attachments => generated 194 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:18:27.903402 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-51dfd9a9-a8da-403c-abda-046d303e476b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:27.911087 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-51dfd9a9-a8da-403c-abda-046d303e476b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1200 microversion: 2.1 time: 0.373452 Jul 04 04:18:27.911660 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 237/493] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:27 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1200 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:28.929761 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1a1743e9-c820-4dd8-adf5-3e1153f5570c tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:28.930959 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-1a1743e9-c820-4dd8-adf5-3e1153f5570c tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:28.939259 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1a1743e9-c820-4dd8-adf5-3e1153f5570c tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:28.939738 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1a1743e9-c820-4dd8-adf5-3e1153f5570c tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:28.940572 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1a1743e9-c820-4dd8-adf5-3e1153f5570c tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:28.941088 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1a1743e9-c820-4dd8-adf5-3e1153f5570c tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:29.097075 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-1a1743e9-c820-4dd8-adf5-3e1153f5570c tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:29.105345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-1a1743e9-c820-4dd8-adf5-3e1153f5570c tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1265 microversion: 2.1 time: 0.180500 Jul 04 04:18:29.106583 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 257/494] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:28 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:29.188865 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-44e40db2-c559-4a29-80ab-ed5d1f29c57c req-782451d3-8a4b-4810-86df-32b07dfd7c35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc36b6d5-12c0-48bd-9aee-afdef9e38c2d", "tag": "f0229d6d-b68b-49d6-b734-20d13d74e25d"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:18:29.198825 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-44e40db2-c559-4a29-80ab-ed5d1f29c57c req-782451d3-8a4b-4810-86df-32b07dfd7c35 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:29.199327 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-44e40db2-c559-4a29-80ab-ed5d1f29c57c req-782451d3-8a4b-4810-86df-32b07dfd7c35 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:29.218153 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-44e40db2-c559-4a29-80ab-ed5d1f29c57c req-782451d3-8a4b-4810-86df-32b07dfd7c35 service nova] Creating event network-changed:f0229d6d-b68b-49d6-b734-20d13d74e25d for instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d on hv-cinder-74216 Jul 04 04:18:29.223239 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-44e40db2-c559-4a29-80ab-ed5d1f29c57c req-782451d3-8a4b-4810-86df-32b07dfd7c35 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039640 Jul 04 04:18:29.223866 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 238/495] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:18:30.127783 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d55fe546-d612-4673-9914-90ed72a328fa tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:30.128845 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d55fe546-d612-4673-9914-90ed72a328fa tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:30.140326 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d55fe546-d612-4673-9914-90ed72a328fa tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:30.141075 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d55fe546-d612-4673-9914-90ed72a328fa tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:30.142343 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d55fe546-d612-4673-9914-90ed72a328fa tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:30.143086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d55fe546-d612-4673-9914-90ed72a328fa tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:30.300366 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d55fe546-d612-4673-9914-90ed72a328fa tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:30.313498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d55fe546-d612-4673-9914-90ed72a328fa tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1265 microversion: 2.1 time: 0.192191 Jul 04 04:18:30.314314 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 258/496] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:30 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:31.333223 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-085709fa-e0d3-4f02-a620-420ac997234e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:31.333952 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-085709fa-e0d3-4f02-a620-420ac997234e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:31.340763 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-085709fa-e0d3-4f02-a620-420ac997234e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:31.341210 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-085709fa-e0d3-4f02-a620-420ac997234e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:31.341988 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-085709fa-e0d3-4f02-a620-420ac997234e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:31.342573 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-085709fa-e0d3-4f02-a620-420ac997234e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:31.488747 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-085709fa-e0d3-4f02-a620-420ac997234e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:31.496837 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-085709fa-e0d3-4f02-a620-420ac997234e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1265 microversion: 2.1 time: 0.168596 Jul 04 04:18:31.497407 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 239/497] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:31 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:32.515213 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3c5a85ca-33d7-49f3-be56-7c936acf8ac6 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:32.515986 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-3c5a85ca-33d7-49f3-be56-7c936acf8ac6 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:32.523607 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3c5a85ca-33d7-49f3-be56-7c936acf8ac6 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:32.524061 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3c5a85ca-33d7-49f3-be56-7c936acf8ac6 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:32.525044 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3c5a85ca-33d7-49f3-be56-7c936acf8ac6 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:32.525953 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3c5a85ca-33d7-49f3-be56-7c936acf8ac6 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:32.685205 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-3c5a85ca-33d7-49f3-be56-7c936acf8ac6 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:32.693515 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3c5a85ca-33d7-49f3-be56-7c936acf8ac6 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1265 microversion: 2.1 time: 0.182816 Jul 04 04:18:32.694087 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 259/498] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:32 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:33.717129 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dc456897-6d61-44fa-9057-804d8cbf85b1 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:33.718191 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dc456897-6d61-44fa-9057-804d8cbf85b1 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:33.730161 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc456897-6d61-44fa-9057-804d8cbf85b1 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:33.730880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc456897-6d61-44fa-9057-804d8cbf85b1 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:33.732359 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc456897-6d61-44fa-9057-804d8cbf85b1 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:33.733262 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dc456897-6d61-44fa-9057-804d8cbf85b1 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:33.895155 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dc456897-6d61-44fa-9057-804d8cbf85b1 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:33.907526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dc456897-6d61-44fa-9057-804d8cbf85b1 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1265 microversion: 2.1 time: 0.197417 Jul 04 04:18:33.908196 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 240/499] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:33 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:34.925126 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d8cff1ec-eb15-46b6-b53e-e653607ea17e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:34.925682 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d8cff1ec-eb15-46b6-b53e-e653607ea17e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:34.932424 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d8cff1ec-eb15-46b6-b53e-e653607ea17e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:34.932864 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d8cff1ec-eb15-46b6-b53e-e653607ea17e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:34.933913 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d8cff1ec-eb15-46b6-b53e-e653607ea17e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:34.934339 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d8cff1ec-eb15-46b6-b53e-e653607ea17e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:35.074414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d8cff1ec-eb15-46b6-b53e-e653607ea17e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:35.082977 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d8cff1ec-eb15-46b6-b53e-e653607ea17e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1265 microversion: 2.1 time: 0.161761 Jul 04 04:18:35.083793 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 260/500] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:34 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:36.101178 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-248b696e-0cf5-46d9-a152-9548b01db6f8 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:36.101849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-248b696e-0cf5-46d9-a152-9548b01db6f8 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:36.110004 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-248b696e-0cf5-46d9-a152-9548b01db6f8 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:36.110580 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-248b696e-0cf5-46d9-a152-9548b01db6f8 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:36.111488 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-248b696e-0cf5-46d9-a152-9548b01db6f8 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:36.111994 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-248b696e-0cf5-46d9-a152-9548b01db6f8 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:36.255115 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-248b696e-0cf5-46d9-a152-9548b01db6f8 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:36.267620 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-248b696e-0cf5-46d9-a152-9548b01db6f8 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1265 microversion: 2.1 time: 0.170955 Jul 04 04:18:36.268402 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 241/501] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:36 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:36.399310 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-262e3122-94f1-4d3e-949c-28800ce47c2e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Action: 'create', calling method: .version_select at 0x7f50c11bf940>, body: {"keypair": {"name": "tempest-keypair-1402810921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbru6YUt3ND8fTTRfYnvQG2HGqBSU9vpyyirQhcZMuz3xp1U+FJgr6YQNloj+VERpU+Nus0+W4FbbYFj9BiV3/7EKsmVdILZf9jfgfCXEU+OsYu/sIV0sUoV4qwwHxIXw=="}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:18:36.404476 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=2 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:36.405108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=6 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:36.417453 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-262e3122-94f1-4d3e-949c-28800ce47c2e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Getting quotas for project 7ccd298eebe6413daaae0d801e902616. Resources: {'key_pairs'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:18:36.421563 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-262e3122-94f1-4d3e-949c-28800ce47c2e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Getting quotas for user 4041faa2919d4760ae10907070a10dc7 and project 7ccd298eebe6413daaae0d801e902616. Resources: {'key_pairs'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:18:36.447888 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-262e3122-94f1-4d3e-949c-28800ce47c2e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052493 Jul 04 04:18:36.448488 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 261/502] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jul 4 04:18:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:18:37.285238 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c2c9e469-8283-4528-abc1-4030b02d1223 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:37.285858 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c2c9e469-8283-4528-abc1-4030b02d1223 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:37.289002 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:37.293576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2c9e469-8283-4528-abc1-4030b02d1223 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:37.294043 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2c9e469-8283-4528-abc1-4030b02d1223 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:37.294849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2c9e469-8283-4528-abc1-4030b02d1223 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:37.295327 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2c9e469-8283-4528-abc1-4030b02d1223 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:37.510019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c2c9e469-8283-4528-abc1-4030b02d1223 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:37.519025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c2c9e469-8283-4528-abc1-4030b02d1223 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1265 microversion: 2.1 time: 0.238180 Jul 04 04:18:37.519765 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 242/503] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:37 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:37.801794 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f4c5f6e1-e205-4b4f-805f-8ea34094750a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2136116991", "imageRef": "46b9937d-f997-401a-a3aa-bb9028764454", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0e412eaf-c623-4c5a-9f62-8e6b8ef74b11"}], "security_groups": [{"name": "tempest-securitygroup--1737764437"}], "key_name": "tempest-keypair-1402810921", "user_data": "}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:18:37.916946 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.network.neutron [None req-f4c5f6e1-e205-4b4f-805f-8ea34094750a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] validate_networks() for [('0e412eaf-c623-4c5a-9f62-8e6b8ef74b11', None, None, None, None, None)] {{(pid=117875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:18:38.320007 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-f4c5f6e1-e205-4b4f-805f-8ea34094750a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Flavor limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:18:38.320428 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-f4c5f6e1-e205-4b4f-805f-8ea34094750a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Image limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:18:38.320894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-f4c5f6e1-e205-4b4f-805f-8ea34094750a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Flavor pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:18:38.321328 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-f4c5f6e1-e205-4b4f-805f-8ea34094750a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Image pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:18:38.321729 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-f4c5f6e1-e205-4b4f-805f-8ea34094750a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:18:38.331192 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f4c5f6e1-e205-4b4f-805f-8ea34094750a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:38.331630 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f4c5f6e1-e205-4b4f-805f-8ea34094750a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:38.332410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f4c5f6e1-e205-4b4f-805f-8ea34094750a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:38.332864 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f4c5f6e1-e205-4b4f-805f-8ea34094750a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:38.349122 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-f4c5f6e1-e205-4b4f-805f-8ea34094750a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Getting quotas for project 7ccd298eebe6413daaae0d801e902616. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:18:38.353128 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-f4c5f6e1-e205-4b4f-805f-8ea34094750a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Getting quotas for user 4041faa2919d4760ae10907070a10dc7 and project 7ccd298eebe6413daaae0d801e902616. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:18:38.364537 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f4c5f6e1-e205-4b4f-805f-8ea34094750a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Going to run 1 instances... {{(pid=117875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:18:38.366874 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f4c5f6e1-e205-4b4f-805f-8ea34094750a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46b9937d-f997-401a-a3aa-bb9028764454',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:18:38.417842 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-f4c5f6e1-e205-4b4f-805f-8ea34094750a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.624109 Jul 04 04:18:38.418509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 262/504] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:18:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 04:18:38.429996 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-746ee91a-fd88-4f46-920f-fd9d252922ff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:38.430678 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-746ee91a-fd88-4f46-920f-fd9d252922ff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:38.494286 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-746ee91a-fd88-4f46-920f-fd9d252922ff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:38.501914 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-746ee91a-fd88-4f46-920f-fd9d252922ff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 200 len: 1242 microversion: 2.1 time: 0.076024 Jul 04 04:18:38.502610 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 243/505] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:38 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:38.536276 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-fff58138-36b7-45e3-9028-891760333571 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:38.536897 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-fff58138-36b7-45e3-9028-891760333571 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:38.544516 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fff58138-36b7-45e3-9028-891760333571 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:38.545076 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fff58138-36b7-45e3-9028-891760333571 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:38.545753 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fff58138-36b7-45e3-9028-891760333571 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:38.546241 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fff58138-36b7-45e3-9028-891760333571 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:38.689949 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-fff58138-36b7-45e3-9028-891760333571 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:38.698392 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-fff58138-36b7-45e3-9028-891760333571 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1265 microversion: 2.1 time: 0.166280 Jul 04 04:18:38.698993 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 263/506] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:38 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:39.520480 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-be2f7686-83f2-4f35-bb23-7f762409502d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:39.521056 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-be2f7686-83f2-4f35-bb23-7f762409502d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:39.530504 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-be2f7686-83f2-4f35-bb23-7f762409502d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:39.532220 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-be2f7686-83f2-4f35-bb23-7f762409502d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:39.533776 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-be2f7686-83f2-4f35-bb23-7f762409502d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:39.534222 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-be2f7686-83f2-4f35-bb23-7f762409502d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:39.641636 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-be2f7686-83f2-4f35-bb23-7f762409502d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:39.655564 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-be2f7686-83f2-4f35-bb23-7f762409502d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 200 len: 1302 microversion: 2.1 time: 0.139736 Jul 04 04:18:39.656972 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 244/507] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:39 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 1302 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:39.717462 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-bc6fbaa4-7d65-436a-8e1d-384dd9d407a3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:39.718924 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-bc6fbaa4-7d65-436a-8e1d-384dd9d407a3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:39.728666 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bc6fbaa4-7d65-436a-8e1d-384dd9d407a3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:39.729454 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bc6fbaa4-7d65-436a-8e1d-384dd9d407a3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:39.730711 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bc6fbaa4-7d65-436a-8e1d-384dd9d407a3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:39.731735 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bc6fbaa4-7d65-436a-8e1d-384dd9d407a3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:39.871963 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-bc6fbaa4-7d65-436a-8e1d-384dd9d407a3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:39.880128 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-bc6fbaa4-7d65-436a-8e1d-384dd9d407a3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1265 microversion: 2.1 time: 0.168381 Jul 04 04:18:39.880711 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 264/508] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:39 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:40.673479 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b5898913-fc0c-44c0-8d13-5cc1a1e313a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:40.674095 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b5898913-fc0c-44c0-8d13-5cc1a1e313a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:40.681469 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5898913-fc0c-44c0-8d13-5cc1a1e313a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:40.681901 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5898913-fc0c-44c0-8d13-5cc1a1e313a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:40.682712 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5898913-fc0c-44c0-8d13-5cc1a1e313a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:40.683400 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b5898913-fc0c-44c0-8d13-5cc1a1e313a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:40.898412 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-02895854-1828-4bc3-9e21-7dee0a491fd3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:40.899072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-02895854-1828-4bc3-9e21-7dee0a491fd3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:40.906022 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b5898913-fc0c-44c0-8d13-5cc1a1e313a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:40.908829 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-02895854-1828-4bc3-9e21-7dee0a491fd3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:40.909290 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-02895854-1828-4bc3-9e21-7dee0a491fd3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:40.910052 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-02895854-1828-4bc3-9e21-7dee0a491fd3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:40.910713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-02895854-1828-4bc3-9e21-7dee0a491fd3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:40.914635 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b5898913-fc0c-44c0-8d13-5cc1a1e313a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 200 len: 1368 microversion: 2.1 time: 0.244939 Jul 04 04:18:40.915313 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 245/509] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:40 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 1368 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:41.067129 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-02895854-1828-4bc3-9e21-7dee0a491fd3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:41.091419 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-02895854-1828-4bc3-9e21-7dee0a491fd3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1265 microversion: 2.1 time: 0.196731 Jul 04 04:18:41.101895 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 265/510] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:40 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:41.185603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-84d1bd7f-61be-4284-a836-da8127877e54 req-ee906bed-7641-411e-992a-d6c951f5cf1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc36b6d5-12c0-48bd-9aee-afdef9e38c2d", "name": "network-vif-plugged", "status": "completed", "tag": "f0229d6d-b68b-49d6-b734-20d13d74e25d"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:18:41.198086 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-84d1bd7f-61be-4284-a836-da8127877e54 req-ee906bed-7641-411e-992a-d6c951f5cf1d service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:41.198673 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-84d1bd7f-61be-4284-a836-da8127877e54 req-ee906bed-7641-411e-992a-d6c951f5cf1d service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:41.213386 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-84d1bd7f-61be-4284-a836-da8127877e54 req-ee906bed-7641-411e-992a-d6c951f5cf1d service nova] Creating event network-vif-plugged:f0229d6d-b68b-49d6-b734-20d13d74e25d for instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d on hv-cinder-74216 Jul 04 04:18:41.220462 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-84d1bd7f-61be-4284-a836-da8127877e54 req-ee906bed-7641-411e-992a-d6c951f5cf1d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039276 Jul 04 04:18:41.222562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 246/511] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:18:41.292694 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-b6a63c2b-cbc8-42de-9980-e5008982d5a6 req-39e15255-ed6b-46b9-b55a-d48d0bc36795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03c5904-d825-409f-a638-bb9ce914aec3", "tag": "b9b0e8c3-8c3b-483a-9a1a-c95a4d7fe2da"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:18:41.302805 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-b6a63c2b-cbc8-42de-9980-e5008982d5a6 req-39e15255-ed6b-46b9-b55a-d48d0bc36795 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:41.303599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-b6a63c2b-cbc8-42de-9980-e5008982d5a6 req-39e15255-ed6b-46b9-b55a-d48d0bc36795 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:41.335688 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-b6a63c2b-cbc8-42de-9980-e5008982d5a6 req-39e15255-ed6b-46b9-b55a-d48d0bc36795 service nova] Creating event network-changed:b9b0e8c3-8c3b-483a-9a1a-c95a4d7fe2da for instance c03c5904-d825-409f-a638-bb9ce914aec3 on hv-cinder-74216 Jul 04 04:18:41.340787 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-b6a63c2b-cbc8-42de-9980-e5008982d5a6 req-39e15255-ed6b-46b9-b55a-d48d0bc36795 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051848 Jul 04 04:18:41.341400 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 266/512] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:18:41.936429 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-19590aa2-51c5-4e35-ab01-f47c2691a86f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:41.937236 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-19590aa2-51c5-4e35-ab01-f47c2691a86f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:41.945954 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19590aa2-51c5-4e35-ab01-f47c2691a86f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:41.946400 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19590aa2-51c5-4e35-ab01-f47c2691a86f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:41.947228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19590aa2-51c5-4e35-ab01-f47c2691a86f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:41.947659 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19590aa2-51c5-4e35-ab01-f47c2691a86f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:42.104444 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-19590aa2-51c5-4e35-ab01-f47c2691a86f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:42.111007 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-2c312d13-93c1-4fa6-a697-c5f69c3fc2b4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:42.111897 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-2c312d13-93c1-4fa6-a697-c5f69c3fc2b4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:42.113239 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-19590aa2-51c5-4e35-ab01-f47c2691a86f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 200 len: 1368 microversion: 2.1 time: 0.182612 Jul 04 04:18:42.113832 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 247/513] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:41 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:42.124402 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2c312d13-93c1-4fa6-a697-c5f69c3fc2b4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:42.125051 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2c312d13-93c1-4fa6-a697-c5f69c3fc2b4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:42.126251 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2c312d13-93c1-4fa6-a697-c5f69c3fc2b4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:42.126953 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2c312d13-93c1-4fa6-a697-c5f69c3fc2b4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:42.280038 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-2c312d13-93c1-4fa6-a697-c5f69c3fc2b4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:42.288216 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-2c312d13-93c1-4fa6-a697-c5f69c3fc2b4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1265 microversion: 2.1 time: 0.182606 Jul 04 04:18:42.288759 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 267/514] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:42 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:18:43.133572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c3f2e165-1edb-4d97-8c09-4261f6a46f46 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:43.134154 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c3f2e165-1edb-4d97-8c09-4261f6a46f46 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:43.142088 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3f2e165-1edb-4d97-8c09-4261f6a46f46 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:43.142578 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3f2e165-1edb-4d97-8c09-4261f6a46f46 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:43.143345 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3f2e165-1edb-4d97-8c09-4261f6a46f46 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:43.143777 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3f2e165-1edb-4d97-8c09-4261f6a46f46 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:43.286414 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c3f2e165-1edb-4d97-8c09-4261f6a46f46 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:43.294416 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c3f2e165-1edb-4d97-8c09-4261f6a46f46 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 200 len: 1368 microversion: 2.1 time: 0.164854 Jul 04 04:18:43.295027 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 248/515] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:43 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:18:43.309091 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e0f08654-c91b-49fb-9144-b37feb57804b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:43.309680 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e0f08654-c91b-49fb-9144-b37feb57804b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:43.316578 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e0f08654-c91b-49fb-9144-b37feb57804b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:43.317025 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e0f08654-c91b-49fb-9144-b37feb57804b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:43.318026 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e0f08654-c91b-49fb-9144-b37feb57804b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:43.318492 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e0f08654-c91b-49fb-9144-b37feb57804b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:43.481741 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e0f08654-c91b-49fb-9144-b37feb57804b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:43.494139 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e0f08654-c91b-49fb-9144-b37feb57804b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1265 microversion: 2.1 time: 0.188583 Jul 04 04:18:43.495074 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 268/516] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:43 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:44.315011 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c7df3d0f-59d5-4ff7-b310-26b7ddebdec3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:44.316186 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c7df3d0f-59d5-4ff7-b310-26b7ddebdec3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:44.324758 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7df3d0f-59d5-4ff7-b310-26b7ddebdec3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:44.325200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7df3d0f-59d5-4ff7-b310-26b7ddebdec3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:44.325989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7df3d0f-59d5-4ff7-b310-26b7ddebdec3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:44.326425 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7df3d0f-59d5-4ff7-b310-26b7ddebdec3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:44.475835 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c7df3d0f-59d5-4ff7-b310-26b7ddebdec3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:44.487092 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c7df3d0f-59d5-4ff7-b310-26b7ddebdec3 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 200 len: 1368 microversion: 2.1 time: 0.178421 Jul 04 04:18:44.487815 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 249/517] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:44 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:44.515488 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e69e4cfb-034f-43de-8a89-590ed5029f09 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:44.516145 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e69e4cfb-034f-43de-8a89-590ed5029f09 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:44.522995 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e69e4cfb-034f-43de-8a89-590ed5029f09 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:44.523450 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e69e4cfb-034f-43de-8a89-590ed5029f09 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:44.524217 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e69e4cfb-034f-43de-8a89-590ed5029f09 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:44.524676 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e69e4cfb-034f-43de-8a89-590ed5029f09 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:44.668112 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e69e4cfb-034f-43de-8a89-590ed5029f09 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:44.676063 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e69e4cfb-034f-43de-8a89-590ed5029f09 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1265 microversion: 2.1 time: 0.164871 Jul 04 04:18:44.676654 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 269/518] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:44 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:45.511915 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-94de95c0-d24a-4d1a-89fa-9e5c42928d62 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:45.512495 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-94de95c0-d24a-4d1a-89fa-9e5c42928d62 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:45.520376 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94de95c0-d24a-4d1a-89fa-9e5c42928d62 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:45.520834 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94de95c0-d24a-4d1a-89fa-9e5c42928d62 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:45.521740 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94de95c0-d24a-4d1a-89fa-9e5c42928d62 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:45.522271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94de95c0-d24a-4d1a-89fa-9e5c42928d62 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:45.660628 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-94de95c0-d24a-4d1a-89fa-9e5c42928d62 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:45.669058 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-94de95c0-d24a-4d1a-89fa-9e5c42928d62 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 200 len: 1368 microversion: 2.1 time: 0.165090 Jul 04 04:18:45.669693 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 250/519] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:45 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:18:45.693704 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-47ed1525-e8be-49fa-9464-1331546bdddf tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:45.694287 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-47ed1525-e8be-49fa-9464-1331546bdddf tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:45.701625 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-47ed1525-e8be-49fa-9464-1331546bdddf tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:45.702086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-47ed1525-e8be-49fa-9464-1331546bdddf tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:45.702885 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-47ed1525-e8be-49fa-9464-1331546bdddf tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:45.703312 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-47ed1525-e8be-49fa-9464-1331546bdddf tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:45.836719 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-47ed1525-e8be-49fa-9464-1331546bdddf tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:45.844327 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-47ed1525-e8be-49fa-9464-1331546bdddf tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1265 microversion: 2.1 time: 0.154667 Jul 04 04:18:45.844899 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 270/520] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:45 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:46.686422 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3a5b75f6-804c-4af7-b232-c670a4ba6475 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:46.687040 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3a5b75f6-804c-4af7-b232-c670a4ba6475 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:46.694005 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a5b75f6-804c-4af7-b232-c670a4ba6475 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:46.694478 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a5b75f6-804c-4af7-b232-c670a4ba6475 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:46.695245 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a5b75f6-804c-4af7-b232-c670a4ba6475 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:46.695674 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a5b75f6-804c-4af7-b232-c670a4ba6475 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:46.849003 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3a5b75f6-804c-4af7-b232-c670a4ba6475 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:46.858745 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3a5b75f6-804c-4af7-b232-c670a4ba6475 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 200 len: 1368 microversion: 2.1 time: 0.176167 Jul 04 04:18:46.859315 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 251/521] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:46 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:46.861131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d543a927-4844-4c3b-b93a-c8bb5b29ff0e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:46.861796 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d543a927-4844-4c3b-b93a-c8bb5b29ff0e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:46.868234 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d543a927-4844-4c3b-b93a-c8bb5b29ff0e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:46.868674 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d543a927-4844-4c3b-b93a-c8bb5b29ff0e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:46.869444 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d543a927-4844-4c3b-b93a-c8bb5b29ff0e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:46.869878 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d543a927-4844-4c3b-b93a-c8bb5b29ff0e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:47.084846 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d543a927-4844-4c3b-b93a-c8bb5b29ff0e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:47.092792 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d543a927-4844-4c3b-b93a-c8bb5b29ff0e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1451 microversion: 2.1 time: 0.235405 Jul 04 04:18:47.093371 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 271/522] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:46 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1451 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:47.110027 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e679a224-3f5f-480b-8b0e-f731000b26d2 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:47.110677 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e679a224-3f5f-480b-8b0e-f731000b26d2 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:47.116768 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e679a224-3f5f-480b-8b0e-f731000b26d2 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:47.117188 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e679a224-3f5f-480b-8b0e-f731000b26d2 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:47.118225 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e679a224-3f5f-480b-8b0e-f731000b26d2 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:47.118665 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e679a224-3f5f-480b-8b0e-f731000b26d2 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:47.345827 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e679a224-3f5f-480b-8b0e-f731000b26d2 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:47.355238 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e679a224-3f5f-480b-8b0e-f731000b26d2 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1451 microversion: 2.1 time: 0.248248 Jul 04 04:18:47.366291 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 252/523] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:47 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1451 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:47.875844 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-dc54e458-d57c-483c-bdc9-c104f20a63a9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:47.876593 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-dc54e458-d57c-483c-bdc9-c104f20a63a9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:47.883160 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dc54e458-d57c-483c-bdc9-c104f20a63a9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:47.883679 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dc54e458-d57c-483c-bdc9-c104f20a63a9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:47.884430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dc54e458-d57c-483c-bdc9-c104f20a63a9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:47.884863 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dc54e458-d57c-483c-bdc9-c104f20a63a9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:48.126511 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-dc54e458-d57c-483c-bdc9-c104f20a63a9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:48.134636 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-dc54e458-d57c-483c-bdc9-c104f20a63a9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 200 len: 1368 microversion: 2.1 time: 0.262758 Jul 04 04:18:48.135222 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 272/524] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:47 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:49.152423 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e62e5b1f-8ce0-4f76-9795-80408a98a55d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:49.153720 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e62e5b1f-8ce0-4f76-9795-80408a98a55d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:49.156330 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:49.162649 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e62e5b1f-8ce0-4f76-9795-80408a98a55d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:49.163101 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e62e5b1f-8ce0-4f76-9795-80408a98a55d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:49.163867 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e62e5b1f-8ce0-4f76-9795-80408a98a55d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:49.164295 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e62e5b1f-8ce0-4f76-9795-80408a98a55d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:49.301942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e62e5b1f-8ce0-4f76-9795-80408a98a55d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:49.309780 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e62e5b1f-8ce0-4f76-9795-80408a98a55d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 200 len: 1368 microversion: 2.1 time: 0.161363 Jul 04 04:18:49.310430 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 253/525] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:49 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:49.439855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-384c0030-f9d2-42ce-a2a2-3e61f0b598d1 req-a6c7b712-9608-4fc2-ae01-e614902f8054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc36b6d5-12c0-48bd-9aee-afdef9e38c2d", "tag": "f0229d6d-b68b-49d6-b734-20d13d74e25d"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:18:49.444631 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=2 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:49.445612 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=10 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:49.451278 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-384c0030-f9d2-42ce-a2a2-3e61f0b598d1 req-a6c7b712-9608-4fc2-ae01-e614902f8054 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:49.451766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-384c0030-f9d2-42ce-a2a2-3e61f0b598d1 req-a6c7b712-9608-4fc2-ae01-e614902f8054 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:49.456036 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:49.464693 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-384c0030-f9d2-42ce-a2a2-3e61f0b598d1 req-a6c7b712-9608-4fc2-ae01-e614902f8054 service nova] Creating event network-changed:f0229d6d-b68b-49d6-b734-20d13d74e25d for instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d on hv-cinder-74216 Jul 04 04:18:49.470570 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-384c0030-f9d2-42ce-a2a2-3e61f0b598d1 req-a6c7b712-9608-4fc2-ae01-e614902f8054 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034741 Jul 04 04:18:49.471111 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 273/526] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:18:50.327260 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b70563bd-a4b2-4e1c-884b-8397f62e8233 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:50.327871 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b70563bd-a4b2-4e1c-884b-8397f62e8233 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:50.334775 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b70563bd-a4b2-4e1c-884b-8397f62e8233 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:50.335229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b70563bd-a4b2-4e1c-884b-8397f62e8233 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:50.335997 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b70563bd-a4b2-4e1c-884b-8397f62e8233 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:50.336431 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b70563bd-a4b2-4e1c-884b-8397f62e8233 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:50.482336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b70563bd-a4b2-4e1c-884b-8397f62e8233 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:50.491268 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b70563bd-a4b2-4e1c-884b-8397f62e8233 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 200 len: 1368 microversion: 2.1 time: 0.168094 Jul 04 04:18:50.491885 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 254/527] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:50 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:51.512497 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a79b5dff-2846-4a9b-8ae1-83d7fed480ba tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:51.514203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a79b5dff-2846-4a9b-8ae1-83d7fed480ba tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:51.521471 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a79b5dff-2846-4a9b-8ae1-83d7fed480ba tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:51.521847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a79b5dff-2846-4a9b-8ae1-83d7fed480ba tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:51.522667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a79b5dff-2846-4a9b-8ae1-83d7fed480ba tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:51.523126 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a79b5dff-2846-4a9b-8ae1-83d7fed480ba tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:51.634949 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-cad3cad9-af44-4a3b-bbca-9ca9c000dd93 req-dc5b364c-287e-4cfd-b2f0-8e32d239fccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03c5904-d825-409f-a638-bb9ce914aec3", "name": "network-vif-plugged", "status": "completed", "tag": "b9b0e8c3-8c3b-483a-9a1a-c95a4d7fe2da"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:18:51.645043 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-cad3cad9-af44-4a3b-bbca-9ca9c000dd93 req-dc5b364c-287e-4cfd-b2f0-8e32d239fccf service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:51.645541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-cad3cad9-af44-4a3b-bbca-9ca9c000dd93 req-dc5b364c-287e-4cfd-b2f0-8e32d239fccf service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:51.649563 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:51.658019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-cad3cad9-af44-4a3b-bbca-9ca9c000dd93 req-dc5b364c-287e-4cfd-b2f0-8e32d239fccf service nova] Creating event network-vif-plugged:b9b0e8c3-8c3b-483a-9a1a-c95a4d7fe2da for instance c03c5904-d825-409f-a638-bb9ce914aec3 on hv-cinder-74216 Jul 04 04:18:51.664176 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-cad3cad9-af44-4a3b-bbca-9ca9c000dd93 req-dc5b364c-287e-4cfd-b2f0-8e32d239fccf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033361 Jul 04 04:18:51.664802 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 255/528] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:18:51.670702 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a79b5dff-2846-4a9b-8ae1-83d7fed480ba tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:51.678850 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a79b5dff-2846-4a9b-8ae1-83d7fed480ba tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 200 len: 1368 microversion: 2.1 time: 0.174023 Jul 04 04:18:51.679604 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 274/529] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:51 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:52.697264 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bea3fafb-26f0-4ae4-b347-117db7f1d1c5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:52.697947 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bea3fafb-26f0-4ae4-b347-117db7f1d1c5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:52.705198 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bea3fafb-26f0-4ae4-b347-117db7f1d1c5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:52.705645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bea3fafb-26f0-4ae4-b347-117db7f1d1c5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:52.706398 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bea3fafb-26f0-4ae4-b347-117db7f1d1c5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:52.706859 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bea3fafb-26f0-4ae4-b347-117db7f1d1c5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:52.846924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bea3fafb-26f0-4ae4-b347-117db7f1d1c5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:52.858728 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bea3fafb-26f0-4ae4-b347-117db7f1d1c5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 200 len: 1368 microversion: 2.1 time: 0.165847 Jul 04 04:18:52.859612 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 256/530] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:52 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:53.880988 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-caca2335-1054-4a2b-b28b-6b8805c0f35c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:53.881610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-caca2335-1054-4a2b-b28b-6b8805c0f35c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:53.889050 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-caca2335-1054-4a2b-b28b-6b8805c0f35c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:53.889413 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-caca2335-1054-4a2b-b28b-6b8805c0f35c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:53.890181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-caca2335-1054-4a2b-b28b-6b8805c0f35c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:53.890624 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-caca2335-1054-4a2b-b28b-6b8805c0f35c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:54.022574 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-caca2335-1054-4a2b-b28b-6b8805c0f35c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:18:54.030548 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-caca2335-1054-4a2b-b28b-6b8805c0f35c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 200 len: 1558 microversion: 2.1 time: 0.153433 Jul 04 04:18:54.031088 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 275/531] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:18:53 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:18:54.047090 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-56adb700-30ee-42e1-a62a-8a6ddc7ad2e5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:18:54.047608 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-56adb700-30ee-42e1-a62a-8a6ddc7ad2e5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:18:54.054239 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56adb700-30ee-42e1-a62a-8a6ddc7ad2e5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:54.054718 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56adb700-30ee-42e1-a62a-8a6ddc7ad2e5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:54.055479 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56adb700-30ee-42e1-a62a-8a6ddc7ad2e5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:54.055904 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56adb700-30ee-42e1-a62a-8a6ddc7ad2e5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:54.139629 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-56adb700-30ee-42e1-a62a-8a6ddc7ad2e5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096360 Jul 04 04:18:54.140388 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 257/532] 10.222.0.16 () {58 vars in 1274 bytes} [Mon Jul 4 04:18:54 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:18:55.117022 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-9de980e8-25e4-41b6-9ebe-63856d489df4 req-e06cf2f2-9df9-4eef-b667-6483cdf70c92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c03c5904-d825-409f-a638-bb9ce914aec3", "tag": "b9b0e8c3-8c3b-483a-9a1a-c95a4d7fe2da"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:18:55.126021 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-9de980e8-25e4-41b6-9ebe-63856d489df4 req-e06cf2f2-9df9-4eef-b667-6483cdf70c92 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:18:55.126583 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-9de980e8-25e4-41b6-9ebe-63856d489df4 req-e06cf2f2-9df9-4eef-b667-6483cdf70c92 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:18:55.137558 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-9de980e8-25e4-41b6-9ebe-63856d489df4 req-e06cf2f2-9df9-4eef-b667-6483cdf70c92 service nova] Creating event network-changed:b9b0e8c3-8c3b-483a-9a1a-c95a4d7fe2da for instance c03c5904-d825-409f-a638-bb9ce914aec3 on hv-cinder-74216 Jul 04 04:18:55.143207 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-9de980e8-25e4-41b6-9ebe-63856d489df4 req-e06cf2f2-9df9-4eef-b667-6483cdf70c92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029899 Jul 04 04:18:55.144009 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 276/533] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:19:09.399045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=50 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:19:09.400072 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=10 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:19:09.406451 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2321fc9f-736f-40d5-9939-a21e9da313f5 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:19:09.407970 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2321fc9f-736f-40d5-9939-a21e9da313f5 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:09.417681 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2321fc9f-736f-40d5-9939-a21e9da313f5 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:09.418132 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2321fc9f-736f-40d5-9939-a21e9da313f5 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:09.418928 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2321fc9f-736f-40d5-9939-a21e9da313f5 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:09.419364 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2321fc9f-736f-40d5-9939-a21e9da313f5 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:09.504846 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2321fc9f-736f-40d5-9939-a21e9da313f5 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "POST /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886/action" status: 202 len: 0 microversion: 2.1 time: 0.108086 Jul 04 04:19:09.505877 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 258/534] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 4 04:19:09 2022] POST /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:19:09.516090 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:19:09.516859 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=14 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:19:09.521513 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-59622f22-a77d-45f6-82f9-5d30532e8665 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:09.522235 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-59622f22-a77d-45f6-82f9-5d30532e8665 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:09.532675 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-59622f22-a77d-45f6-82f9-5d30532e8665 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:09.533115 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-59622f22-a77d-45f6-82f9-5d30532e8665 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:09.533896 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-59622f22-a77d-45f6-82f9-5d30532e8665 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:09.534330 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-59622f22-a77d-45f6-82f9-5d30532e8665 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:09.693092 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-59622f22-a77d-45f6-82f9-5d30532e8665 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:09.701658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-59622f22-a77d-45f6-82f9-5d30532e8665 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1747 microversion: 2.1 time: 0.188806 Jul 04 04:19:09.702217 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 277/535] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:09 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1747 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:10.720822 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bf59d342-97a8-45e7-81f3-8c32ca9983c1 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:10.721569 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bf59d342-97a8-45e7-81f3-8c32ca9983c1 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:10.728070 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf59d342-97a8-45e7-81f3-8c32ca9983c1 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:10.728447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf59d342-97a8-45e7-81f3-8c32ca9983c1 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:10.729198 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf59d342-97a8-45e7-81f3-8c32ca9983c1 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:10.729623 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bf59d342-97a8-45e7-81f3-8c32ca9983c1 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:10.889819 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bf59d342-97a8-45e7-81f3-8c32ca9983c1 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:10.902597 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bf59d342-97a8-45e7-81f3-8c32ca9983c1 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1752 microversion: 2.1 time: 0.186380 Jul 04 04:19:10.903309 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 259/536] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:10 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1752 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:11.921662 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-fb458da2-af09-45d1-83cb-f5525a801428 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:11.922310 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-fb458da2-af09-45d1-83cb-f5525a801428 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:11.929598 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fb458da2-af09-45d1-83cb-f5525a801428 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:11.930053 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fb458da2-af09-45d1-83cb-f5525a801428 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:11.930859 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fb458da2-af09-45d1-83cb-f5525a801428 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:11.931296 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fb458da2-af09-45d1-83cb-f5525a801428 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:12.084566 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-fb458da2-af09-45d1-83cb-f5525a801428 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:12.094318 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-fb458da2-af09-45d1-83cb-f5525a801428 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1752 microversion: 2.1 time: 0.177257 Jul 04 04:19:12.094937 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 278/537] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:11 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:12.749247 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b075b022-0305-4407-923f-bb9bb10e2b41 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:12.749835 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b075b022-0305-4407-923f-bb9bb10e2b41 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:12.757013 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b075b022-0305-4407-923f-bb9bb10e2b41 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:12.757467 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b075b022-0305-4407-923f-bb9bb10e2b41 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:12.758214 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b075b022-0305-4407-923f-bb9bb10e2b41 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:12.758680 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b075b022-0305-4407-923f-bb9bb10e2b41 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:12.783839 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b075b022-0305-4407-923f-bb9bb10e2b41 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/ips" status: 200 len: 151 microversion: 2.20 time: 0.038856 Jul 04 04:19:12.784581 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 260/538] 10.222.0.16 () {60 vars in 1288 bytes} [Mon Jul 4 04:19:12 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:19:13.113308 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-8075bfbd-179b-4858-82ea-ac0055791842 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:13.113992 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-8075bfbd-179b-4858-82ea-ac0055791842 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:13.120714 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8075bfbd-179b-4858-82ea-ac0055791842 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:13.121248 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8075bfbd-179b-4858-82ea-ac0055791842 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:13.122119 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8075bfbd-179b-4858-82ea-ac0055791842 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:13.122648 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8075bfbd-179b-4858-82ea-ac0055791842 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:13.281387 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-8075bfbd-179b-4858-82ea-ac0055791842 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:13.294542 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-8075bfbd-179b-4858-82ea-ac0055791842 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1752 microversion: 2.1 time: 0.185453 Jul 04 04:19:13.295213 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 279/539] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:13 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1752 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:14.314714 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-83211f2d-78ff-4e1a-bbe9-daea4865ed4e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:14.315287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-83211f2d-78ff-4e1a-bbe9-daea4865ed4e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:14.322877 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83211f2d-78ff-4e1a-bbe9-daea4865ed4e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:14.323328 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83211f2d-78ff-4e1a-bbe9-daea4865ed4e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:14.324096 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83211f2d-78ff-4e1a-bbe9-daea4865ed4e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:14.324535 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83211f2d-78ff-4e1a-bbe9-daea4865ed4e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:14.480730 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-83211f2d-78ff-4e1a-bbe9-daea4865ed4e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:14.493751 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-83211f2d-78ff-4e1a-bbe9-daea4865ed4e tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1752 microversion: 2.1 time: 0.183392 Jul 04 04:19:14.494592 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 261/540] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:14 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1752 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:14.908713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3a17ae9a-0815-45aa-9608-524485c5c6db tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:19:14.909541 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-3a17ae9a-0815-45aa-9608-524485c5c6db tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:14.920529 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3a17ae9a-0815-45aa-9608-524485c5c6db tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:14.921090 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3a17ae9a-0815-45aa-9608-524485c5c6db tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:14.921875 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3a17ae9a-0815-45aa-9608-524485c5c6db tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:14.922306 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3a17ae9a-0815-45aa-9608-524485c5c6db tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:14.946862 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.objects.instance [None req-3a17ae9a-0815-45aa-9608-524485c5c6db tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lazy-loading 'flavor' on Instance uuid c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 {{(pid=117875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:19:15.256754 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3a17ae9a-0815-45aa-9608-524485c5c6db tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "POST /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/action" status: 202 len: 0 microversion: 2.20 time: 0.354339 Jul 04 04:19:15.257606 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 280/541] 10.222.0.16 () {62 vars in 1318 bytes} [Mon Jul 4 04:19:14 2022] POST /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:19:15.266687 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f33006d8-6b88-423a-b200-89b9ee67adb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:15.267873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f33006d8-6b88-423a-b200-89b9ee67adb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:15.274282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f33006d8-6b88-423a-b200-89b9ee67adb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:15.274856 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f33006d8-6b88-423a-b200-89b9ee67adb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:15.275711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f33006d8-6b88-423a-b200-89b9ee67adb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:15.276157 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f33006d8-6b88-423a-b200-89b9ee67adb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:15.412038 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f33006d8-6b88-423a-b200-89b9ee67adb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:15.420435 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f33006d8-6b88-423a-b200-89b9ee67adb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:15.421902 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f33006d8-6b88-423a-b200-89b9ee67adb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:15.423080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f33006d8-6b88-423a-b200-89b9ee67adb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1722 microversion: 2.20 time: 0.160938 Jul 04 04:19:15.423638 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 262/542] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:15 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:15.516901 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-db01ad4e-0969-424c-927c-8b8fb2e62ee8 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:15.517636 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-db01ad4e-0969-424c-927c-8b8fb2e62ee8 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:15.524459 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db01ad4e-0969-424c-927c-8b8fb2e62ee8 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:15.524904 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db01ad4e-0969-424c-927c-8b8fb2e62ee8 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:15.525673 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db01ad4e-0969-424c-927c-8b8fb2e62ee8 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:15.526109 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db01ad4e-0969-424c-927c-8b8fb2e62ee8 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:15.676321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-db01ad4e-0969-424c-927c-8b8fb2e62ee8 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:15.684679 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-db01ad4e-0969-424c-927c-8b8fb2e62ee8 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1752 microversion: 2.1 time: 0.173651 Jul 04 04:19:15.685291 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 281/543] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:15 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:16.445930 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-affb5836-c7d6-4b62-9e56-f1ad6d86b9f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:16.446927 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-affb5836-c7d6-4b62-9e56-f1ad6d86b9f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:16.455339 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-affb5836-c7d6-4b62-9e56-f1ad6d86b9f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:16.455784 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-affb5836-c7d6-4b62-9e56-f1ad6d86b9f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:16.456539 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-affb5836-c7d6-4b62-9e56-f1ad6d86b9f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:16.456966 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-affb5836-c7d6-4b62-9e56-f1ad6d86b9f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:16.605993 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-affb5836-c7d6-4b62-9e56-f1ad6d86b9f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:16.615967 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-affb5836-c7d6-4b62-9e56-f1ad6d86b9f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:16.617456 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-affb5836-c7d6-4b62-9e56-f1ad6d86b9f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:16.618672 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-affb5836-c7d6-4b62-9e56-f1ad6d86b9f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1722 microversion: 2.20 time: 0.179236 Jul 04 04:19:16.619250 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 263/544] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:16 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:16.702708 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d2fc316e-8b6a-4fa6-b5ba-b620e1a44185 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:16.703270 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d2fc316e-8b6a-4fa6-b5ba-b620e1a44185 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:16.711197 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d2fc316e-8b6a-4fa6-b5ba-b620e1a44185 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:16.711691 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d2fc316e-8b6a-4fa6-b5ba-b620e1a44185 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:16.712549 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d2fc316e-8b6a-4fa6-b5ba-b620e1a44185 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:16.713026 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d2fc316e-8b6a-4fa6-b5ba-b620e1a44185 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:16.864963 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d2fc316e-8b6a-4fa6-b5ba-b620e1a44185 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:16.876493 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d2fc316e-8b6a-4fa6-b5ba-b620e1a44185 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1752 microversion: 2.1 time: 0.178714 Jul 04 04:19:16.877066 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 282/545] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:16 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:17.641402 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-377e9ce8-b966-4102-8c89-4bc7b36ce5e2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:17.642434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-377e9ce8-b966-4102-8c89-4bc7b36ce5e2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:17.653400 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-377e9ce8-b966-4102-8c89-4bc7b36ce5e2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:17.654194 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-377e9ce8-b966-4102-8c89-4bc7b36ce5e2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:17.654997 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-377e9ce8-b966-4102-8c89-4bc7b36ce5e2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:17.655423 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-377e9ce8-b966-4102-8c89-4bc7b36ce5e2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:17.792171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-377e9ce8-b966-4102-8c89-4bc7b36ce5e2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:17.800701 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-377e9ce8-b966-4102-8c89-4bc7b36ce5e2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:17.802183 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-377e9ce8-b966-4102-8c89-4bc7b36ce5e2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:17.803363 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-377e9ce8-b966-4102-8c89-4bc7b36ce5e2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1722 microversion: 2.20 time: 0.168778 Jul 04 04:19:17.803934 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 264/546] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:17 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:17.898196 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7b5db68c-150f-4d99-a012-b5660c76bd79 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:17.899181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7b5db68c-150f-4d99-a012-b5660c76bd79 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:17.910275 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7b5db68c-150f-4d99-a012-b5660c76bd79 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:17.911092 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7b5db68c-150f-4d99-a012-b5660c76bd79 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:17.912382 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7b5db68c-150f-4d99-a012-b5660c76bd79 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:17.913105 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7b5db68c-150f-4d99-a012-b5660c76bd79 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:18.068160 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7b5db68c-150f-4d99-a012-b5660c76bd79 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:18.076851 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7b5db68c-150f-4d99-a012-b5660c76bd79 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1752 microversion: 2.1 time: 0.185200 Jul 04 04:19:18.077597 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 283/547] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:17 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1752 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:18.825240 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-52475f59-a54b-4f47-968e-d6512f42c61b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:18.826635 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-52475f59-a54b-4f47-968e-d6512f42c61b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:18.837684 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52475f59-a54b-4f47-968e-d6512f42c61b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:18.838439 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52475f59-a54b-4f47-968e-d6512f42c61b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:18.839786 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52475f59-a54b-4f47-968e-d6512f42c61b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:18.840502 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-52475f59-a54b-4f47-968e-d6512f42c61b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:18.972175 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-52475f59-a54b-4f47-968e-d6512f42c61b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:18.986446 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-52475f59-a54b-4f47-968e-d6512f42c61b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:18.988883 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-52475f59-a54b-4f47-968e-d6512f42c61b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:18.990831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-52475f59-a54b-4f47-968e-d6512f42c61b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1722 microversion: 2.20 time: 0.171967 Jul 04 04:19:18.991733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 265/548] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:18 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:19.096565 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f4301e77-0d77-481d-b18b-1ba6a2ad2a30 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:19.097242 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f4301e77-0d77-481d-b18b-1ba6a2ad2a30 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:19.105343 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f4301e77-0d77-481d-b18b-1ba6a2ad2a30 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:19.105869 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f4301e77-0d77-481d-b18b-1ba6a2ad2a30 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:19.106807 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f4301e77-0d77-481d-b18b-1ba6a2ad2a30 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:19.107316 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f4301e77-0d77-481d-b18b-1ba6a2ad2a30 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:19.279937 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f4301e77-0d77-481d-b18b-1ba6a2ad2a30 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:19.288369 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-f4301e77-0d77-481d-b18b-1ba6a2ad2a30 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1752 microversion: 2.1 time: 0.196734 Jul 04 04:19:19.288971 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 284/549] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:19 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1752 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:20.016226 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c40f9481-35a8-4a91-96c0-f6dfd90515cb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:20.016852 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c40f9481-35a8-4a91-96c0-f6dfd90515cb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:20.024472 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c40f9481-35a8-4a91-96c0-f6dfd90515cb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:20.024943 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c40f9481-35a8-4a91-96c0-f6dfd90515cb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:20.025762 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c40f9481-35a8-4a91-96c0-f6dfd90515cb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:20.026218 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c40f9481-35a8-4a91-96c0-f6dfd90515cb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:20.174562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c40f9481-35a8-4a91-96c0-f6dfd90515cb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:20.186601 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c40f9481-35a8-4a91-96c0-f6dfd90515cb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:20.189427 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c40f9481-35a8-4a91-96c0-f6dfd90515cb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:20.191202 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c40f9481-35a8-4a91-96c0-f6dfd90515cb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1722 microversion: 2.20 time: 0.180095 Jul 04 04:19:20.191972 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 266/550] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:20 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:20.309631 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-34a1e356-8b6b-4dff-983b-3c4898abbf09 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:20.310628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-34a1e356-8b6b-4dff-983b-3c4898abbf09 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:20.317743 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-34a1e356-8b6b-4dff-983b-3c4898abbf09 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:20.318194 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-34a1e356-8b6b-4dff-983b-3c4898abbf09 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:20.318994 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-34a1e356-8b6b-4dff-983b-3c4898abbf09 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:20.319430 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-34a1e356-8b6b-4dff-983b-3c4898abbf09 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:20.463365 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-34a1e356-8b6b-4dff-983b-3c4898abbf09 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:20.472917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-34a1e356-8b6b-4dff-983b-3c4898abbf09 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1752 microversion: 2.1 time: 0.169754 Jul 04 04:19:20.473793 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 285/551] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:20 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:21.217765 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-240c85f9-d5bc-410b-b74a-7d4299668b2f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:21.218384 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-240c85f9-d5bc-410b-b74a-7d4299668b2f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:21.225491 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-240c85f9-d5bc-410b-b74a-7d4299668b2f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:21.225938 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-240c85f9-d5bc-410b-b74a-7d4299668b2f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:21.226810 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-240c85f9-d5bc-410b-b74a-7d4299668b2f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:21.227241 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-240c85f9-d5bc-410b-b74a-7d4299668b2f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:21.363343 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-240c85f9-d5bc-410b-b74a-7d4299668b2f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:21.371889 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-240c85f9-d5bc-410b-b74a-7d4299668b2f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:21.373412 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-240c85f9-d5bc-410b-b74a-7d4299668b2f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:21.374595 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-240c85f9-d5bc-410b-b74a-7d4299668b2f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1722 microversion: 2.20 time: 0.163798 Jul 04 04:19:21.375161 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 267/552] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:21 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:21.493998 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5a9250ca-329a-4b54-b011-d12199c2c696 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:21.495110 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5a9250ca-329a-4b54-b011-d12199c2c696 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:21.506098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5a9250ca-329a-4b54-b011-d12199c2c696 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:21.506883 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5a9250ca-329a-4b54-b011-d12199c2c696 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:21.508139 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5a9250ca-329a-4b54-b011-d12199c2c696 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:21.508854 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5a9250ca-329a-4b54-b011-d12199c2c696 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:21.663231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5a9250ca-329a-4b54-b011-d12199c2c696 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:21.671949 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5a9250ca-329a-4b54-b011-d12199c2c696 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1752 microversion: 2.1 time: 0.184487 Jul 04 04:19:21.672521 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 286/553] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:21 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1752 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:22.398408 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a222e2a2-6c72-454a-b675-1c707a9cc92f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:22.399399 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a222e2a2-6c72-454a-b675-1c707a9cc92f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:22.411018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a222e2a2-6c72-454a-b675-1c707a9cc92f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:22.411773 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a222e2a2-6c72-454a-b675-1c707a9cc92f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:22.413025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a222e2a2-6c72-454a-b675-1c707a9cc92f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:22.413777 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a222e2a2-6c72-454a-b675-1c707a9cc92f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:22.562855 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a222e2a2-6c72-454a-b675-1c707a9cc92f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:22.571092 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a222e2a2-6c72-454a-b675-1c707a9cc92f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:22.572582 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a222e2a2-6c72-454a-b675-1c707a9cc92f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:22.573749 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a222e2a2-6c72-454a-b675-1c707a9cc92f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1722 microversion: 2.20 time: 0.181969 Jul 04 04:19:22.574314 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 268/554] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:22 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:22.689586 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b571b43f-57db-44a5-a569-63cc2f38eaa7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:22.690244 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b571b43f-57db-44a5-a569-63cc2f38eaa7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:22.696821 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b571b43f-57db-44a5-a569-63cc2f38eaa7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:22.697262 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b571b43f-57db-44a5-a569-63cc2f38eaa7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:22.698013 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b571b43f-57db-44a5-a569-63cc2f38eaa7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:22.698437 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b571b43f-57db-44a5-a569-63cc2f38eaa7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:22.847859 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b571b43f-57db-44a5-a569-63cc2f38eaa7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:22.856278 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b571b43f-57db-44a5-a569-63cc2f38eaa7 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1755 microversion: 2.1 time: 0.170961 Jul 04 04:19:22.856843 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 287/555] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:22 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:23.594008 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0a106b3c-0a90-4eed-b5fc-5342fed9a1c0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:23.594662 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0a106b3c-0a90-4eed-b5fc-5342fed9a1c0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:23.601598 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a106b3c-0a90-4eed-b5fc-5342fed9a1c0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:23.602047 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a106b3c-0a90-4eed-b5fc-5342fed9a1c0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:23.602869 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a106b3c-0a90-4eed-b5fc-5342fed9a1c0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:23.603291 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a106b3c-0a90-4eed-b5fc-5342fed9a1c0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:23.741437 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0a106b3c-0a90-4eed-b5fc-5342fed9a1c0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:23.753997 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0a106b3c-0a90-4eed-b5fc-5342fed9a1c0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:23.756380 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0a106b3c-0a90-4eed-b5fc-5342fed9a1c0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:23.758214 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0a106b3c-0a90-4eed-b5fc-5342fed9a1c0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1722 microversion: 2.20 time: 0.169030 Jul 04 04:19:23.759101 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 269/556] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:23 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:24.781521 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-92a77cb1-730d-4b0b-8b9e-c723dc5e421a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:24.782130 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-92a77cb1-730d-4b0b-8b9e-c723dc5e421a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:24.789229 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-92a77cb1-730d-4b0b-8b9e-c723dc5e421a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:24.789675 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-92a77cb1-730d-4b0b-8b9e-c723dc5e421a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:24.790473 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-92a77cb1-730d-4b0b-8b9e-c723dc5e421a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:24.790940 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-92a77cb1-730d-4b0b-8b9e-c723dc5e421a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:24.923754 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-92a77cb1-730d-4b0b-8b9e-c723dc5e421a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:24.932343 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-92a77cb1-730d-4b0b-8b9e-c723dc5e421a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:24.933826 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-92a77cb1-730d-4b0b-8b9e-c723dc5e421a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:24.935031 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-92a77cb1-730d-4b0b-8b9e-c723dc5e421a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1722 microversion: 2.20 time: 0.158820 Jul 04 04:19:24.935708 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 288/557] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:24 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:25.956245 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ff2027cd-f13c-46d2-a753-8555ff357440 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:25.956900 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ff2027cd-f13c-46d2-a753-8555ff357440 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:25.964927 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff2027cd-f13c-46d2-a753-8555ff357440 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:25.965457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff2027cd-f13c-46d2-a753-8555ff357440 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:25.966338 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff2027cd-f13c-46d2-a753-8555ff357440 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:25.967499 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff2027cd-f13c-46d2-a753-8555ff357440 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:26.120243 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ff2027cd-f13c-46d2-a753-8555ff357440 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:26.129155 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ff2027cd-f13c-46d2-a753-8555ff357440 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:26.130689 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ff2027cd-f13c-46d2-a753-8555ff357440 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:26.131853 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ff2027cd-f13c-46d2-a753-8555ff357440 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1722 microversion: 2.20 time: 0.180892 Jul 04 04:19:26.132420 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 270/558] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:25 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:27.153716 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-2858b082-50c7-44ce-9f29-841cd654f7c9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:27.154645 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-2858b082-50c7-44ce-9f29-841cd654f7c9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:27.161878 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2858b082-50c7-44ce-9f29-841cd654f7c9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:27.162327 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2858b082-50c7-44ce-9f29-841cd654f7c9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:27.163129 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2858b082-50c7-44ce-9f29-841cd654f7c9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:27.163564 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2858b082-50c7-44ce-9f29-841cd654f7c9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:27.310138 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-2858b082-50c7-44ce-9f29-841cd654f7c9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:27.318983 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-2858b082-50c7-44ce-9f29-841cd654f7c9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:27.320557 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-2858b082-50c7-44ce-9f29-841cd654f7c9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:27.321729 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-2858b082-50c7-44ce-9f29-841cd654f7c9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1743 microversion: 2.20 time: 0.173650 Jul 04 04:19:27.322308 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 289/559] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:27 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:28.340748 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-053be89d-7073-4bd0-aa4e-64e7956cbaf9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:28.341355 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-053be89d-7073-4bd0-aa4e-64e7956cbaf9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:28.348358 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-053be89d-7073-4bd0-aa4e-64e7956cbaf9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:28.348801 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-053be89d-7073-4bd0-aa4e-64e7956cbaf9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:28.349557 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-053be89d-7073-4bd0-aa4e-64e7956cbaf9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:28.349987 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-053be89d-7073-4bd0-aa4e-64e7956cbaf9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:28.488609 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-053be89d-7073-4bd0-aa4e-64e7956cbaf9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:28.499717 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-053be89d-7073-4bd0-aa4e-64e7956cbaf9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:28.502042 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-053be89d-7073-4bd0-aa4e-64e7956cbaf9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:28.503450 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-053be89d-7073-4bd0-aa4e-64e7956cbaf9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1743 microversion: 2.20 time: 0.166703 Jul 04 04:19:28.504002 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 271/560] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:28 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:29.522928 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9005a596-e7c8-421d-95a7-8f87a89e6586 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:29.523709 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-9005a596-e7c8-421d-95a7-8f87a89e6586 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:29.532006 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9005a596-e7c8-421d-95a7-8f87a89e6586 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:29.532452 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9005a596-e7c8-421d-95a7-8f87a89e6586 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:29.533207 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9005a596-e7c8-421d-95a7-8f87a89e6586 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:29.533633 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9005a596-e7c8-421d-95a7-8f87a89e6586 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:29.678607 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9005a596-e7c8-421d-95a7-8f87a89e6586 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:29.688682 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9005a596-e7c8-421d-95a7-8f87a89e6586 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:29.690549 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9005a596-e7c8-421d-95a7-8f87a89e6586 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:29.692076 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9005a596-e7c8-421d-95a7-8f87a89e6586 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1743 microversion: 2.20 time: 0.173970 Jul 04 04:19:29.693375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 290/561] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:29 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:30.711823 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ecb1045d-d3a1-461c-9ebb-f803286d6c2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:30.712424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ecb1045d-d3a1-461c-9ebb-f803286d6c2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:30.719576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecb1045d-d3a1-461c-9ebb-f803286d6c2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:30.720026 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecb1045d-d3a1-461c-9ebb-f803286d6c2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:30.720784 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecb1045d-d3a1-461c-9ebb-f803286d6c2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:30.721211 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecb1045d-d3a1-461c-9ebb-f803286d6c2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:30.856530 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ecb1045d-d3a1-461c-9ebb-f803286d6c2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:30.864834 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ecb1045d-d3a1-461c-9ebb-f803286d6c2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:30.866357 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ecb1045d-d3a1-461c-9ebb-f803286d6c2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:30.867625 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ecb1045d-d3a1-461c-9ebb-f803286d6c2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1743 microversion: 2.20 time: 0.160025 Jul 04 04:19:30.868191 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 272/562] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:30 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:31.886048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c97a21ec-3b0c-4bbc-9c7e-90644561102a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:31.886707 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c97a21ec-3b0c-4bbc-9c7e-90644561102a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:31.894199 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c97a21ec-3b0c-4bbc-9c7e-90644561102a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:31.894957 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c97a21ec-3b0c-4bbc-9c7e-90644561102a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:31.895425 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c97a21ec-3b0c-4bbc-9c7e-90644561102a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:31.895854 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c97a21ec-3b0c-4bbc-9c7e-90644561102a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:31.900097 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-6aef057a-f981-49c1-8833-153b32dcf4a2 req-3d8cc7a3-f206-4626-8308-71fdaea36b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e151ec-4f75-4bfe-8c27-3d6ac7c72453", "name": "network-vif-plugged", "status": "completed", "tag": "72e623a1-47a8-4ba4-ae5c-a1c4eb8869fc"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:19:31.911449 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-6aef057a-f981-49c1-8833-153b32dcf4a2 req-3d8cc7a3-f206-4626-8308-71fdaea36b96 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:31.912412 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-6aef057a-f981-49c1-8833-153b32dcf4a2 req-3d8cc7a3-f206-4626-8308-71fdaea36b96 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:31.917016 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:19:31.925998 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-6aef057a-f981-49c1-8833-153b32dcf4a2 req-3d8cc7a3-f206-4626-8308-71fdaea36b96 service nova] Creating event network-vif-plugged:72e623a1-47a8-4ba4-ae5c-a1c4eb8869fc for instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 on hv-cinder-74216 Jul 04 04:19:31.931504 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-6aef057a-f981-49c1-8833-153b32dcf4a2 req-3d8cc7a3-f206-4626-8308-71fdaea36b96 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035144 Jul 04 04:19:31.932946 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 273/563] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:19:32.089118 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c97a21ec-3b0c-4bbc-9c7e-90644561102a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:32.101630 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c97a21ec-3b0c-4bbc-9c7e-90644561102a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:32.103636 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c97a21ec-3b0c-4bbc-9c7e-90644561102a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:32.105350 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c97a21ec-3b0c-4bbc-9c7e-90644561102a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1743 microversion: 2.20 time: 0.223769 Jul 04 04:19:32.106137 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 291/564] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:31 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1743 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:33.129003 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6c0d476c-9a30-415c-a838-78e6824f5827 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:33.129783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6c0d476c-9a30-415c-a838-78e6824f5827 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:33.137294 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c0d476c-9a30-415c-a838-78e6824f5827 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:33.137786 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c0d476c-9a30-415c-a838-78e6824f5827 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:33.139084 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c0d476c-9a30-415c-a838-78e6824f5827 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:33.139559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c0d476c-9a30-415c-a838-78e6824f5827 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:33.159187 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:19:33.334328 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6c0d476c-9a30-415c-a838-78e6824f5827 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:33.345494 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6c0d476c-9a30-415c-a838-78e6824f5827 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:33.347021 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6c0d476c-9a30-415c-a838-78e6824f5827 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:33.348189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6c0d476c-9a30-415c-a838-78e6824f5827 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1743 microversion: 2.20 time: 0.225416 Jul 04 04:19:33.348768 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 274/565] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:33 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1743 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:34.367934 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9385224d-99db-4f41-9328-5e211d1be632 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:34.368490 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-9385224d-99db-4f41-9328-5e211d1be632 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:34.378154 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9385224d-99db-4f41-9328-5e211d1be632 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:34.378644 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9385224d-99db-4f41-9328-5e211d1be632 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:34.379468 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9385224d-99db-4f41-9328-5e211d1be632 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:34.379873 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9385224d-99db-4f41-9328-5e211d1be632 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:34.531369 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9385224d-99db-4f41-9328-5e211d1be632 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:34.541706 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9385224d-99db-4f41-9328-5e211d1be632 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:34.544135 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9385224d-99db-4f41-9328-5e211d1be632 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:34.545607 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9385224d-99db-4f41-9328-5e211d1be632 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1738 microversion: 2.20 time: 0.182304 Jul 04 04:19:34.546655 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 292/566] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:34 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:35.571040 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-125009da-4069-4239-859c-ba80299c4f51 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:35.571648 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-125009da-4069-4239-859c-ba80299c4f51 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:35.580255 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-125009da-4069-4239-859c-ba80299c4f51 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:35.581199 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-125009da-4069-4239-859c-ba80299c4f51 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:35.582241 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-125009da-4069-4239-859c-ba80299c4f51 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:35.582773 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-125009da-4069-4239-859c-ba80299c4f51 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:35.727131 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-125009da-4069-4239-859c-ba80299c4f51 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:35.737096 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-125009da-4069-4239-859c-ba80299c4f51 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:35.738630 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-125009da-4069-4239-859c-ba80299c4f51 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:35.740018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-125009da-4069-4239-859c-ba80299c4f51 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1738 microversion: 2.20 time: 0.175873 Jul 04 04:19:35.740762 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 275/567] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:35 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 04:19:36.603558 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-92c6531d-4877-41b1-b97e-9979eea57389 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a55e874c-f8a8-43e8-b2f9-9ae7f0b91f70"}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:19:36.604696 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-92c6531d-4877-41b1-b97e-9979eea57389 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:36.612277 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-92c6531d-4877-41b1-b97e-9979eea57389 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:36.612739 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-92c6531d-4877-41b1-b97e-9979eea57389 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:36.613566 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-92c6531d-4877-41b1-b97e-9979eea57389 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:36.614027 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-92c6531d-4877-41b1-b97e-9979eea57389 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:36.757937 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3c57a0f7-2e0a-48d0-add0-6a56753f81bd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:36.759415 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3c57a0f7-2e0a-48d0-add0-6a56753f81bd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:36.768680 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c57a0f7-2e0a-48d0-add0-6a56753f81bd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:36.769739 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c57a0f7-2e0a-48d0-add0-6a56753f81bd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:36.770701 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c57a0f7-2e0a-48d0-add0-6a56753f81bd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:36.771204 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c57a0f7-2e0a-48d0-add0-6a56753f81bd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:36.930968 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3c57a0f7-2e0a-48d0-add0-6a56753f81bd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:36.940406 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3c57a0f7-2e0a-48d0-add0-6a56753f81bd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:36.942686 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3c57a0f7-2e0a-48d0-add0-6a56753f81bd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:36.944611 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3c57a0f7-2e0a-48d0-add0-6a56753f81bd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1738 microversion: 2.20 time: 0.190686 Jul 04 04:19:36.957387 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 276/568] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:36 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:36.978187 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-92c6531d-4877-41b1-b97e-9979eea57389 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "POST /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380094 Jul 04 04:19:36.979145 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 293/569] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jul 4 04:19:36 2022] POST /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:19:37.963905 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1d591767-6eff-4c1d-af83-ac6adf4e6ba9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:37.964476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1d591767-6eff-4c1d-af83-ac6adf4e6ba9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:37.971419 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d591767-6eff-4c1d-af83-ac6adf4e6ba9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:37.972157 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d591767-6eff-4c1d-af83-ac6adf4e6ba9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:37.972943 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d591767-6eff-4c1d-af83-ac6adf4e6ba9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:37.973385 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d591767-6eff-4c1d-af83-ac6adf4e6ba9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:38.126323 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1d591767-6eff-4c1d-af83-ac6adf4e6ba9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:38.135320 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1d591767-6eff-4c1d-af83-ac6adf4e6ba9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:38.136902 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1d591767-6eff-4c1d-af83-ac6adf4e6ba9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:38.138709 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1d591767-6eff-4c1d-af83-ac6adf4e6ba9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1738 microversion: 2.20 time: 0.179372 Jul 04 04:19:38.139432 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 277/570] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:37 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:39.159998 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7ff07f05-aa57-40ad-afda-5ce0a7e27089 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:39.160828 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7ff07f05-aa57-40ad-afda-5ce0a7e27089 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:39.168905 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7ff07f05-aa57-40ad-afda-5ce0a7e27089 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:39.169582 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7ff07f05-aa57-40ad-afda-5ce0a7e27089 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:39.170591 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7ff07f05-aa57-40ad-afda-5ce0a7e27089 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:39.171308 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7ff07f05-aa57-40ad-afda-5ce0a7e27089 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:39.322341 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7ff07f05-aa57-40ad-afda-5ce0a7e27089 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:39.336382 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7ff07f05-aa57-40ad-afda-5ce0a7e27089 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:39.339505 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7ff07f05-aa57-40ad-afda-5ce0a7e27089 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:39.341231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7ff07f05-aa57-40ad-afda-5ce0a7e27089 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1738 microversion: 2.20 time: 0.187664 Jul 04 04:19:39.355305 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 294/571] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:39 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:40.361138 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2ba32346-88be-48ea-a59f-c6f238283b27 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:40.361840 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2ba32346-88be-48ea-a59f-c6f238283b27 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:40.365777 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=41 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:19:40.369875 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ba32346-88be-48ea-a59f-c6f238283b27 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:40.370389 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ba32346-88be-48ea-a59f-c6f238283b27 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:40.371329 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ba32346-88be-48ea-a59f-c6f238283b27 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:40.371784 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ba32346-88be-48ea-a59f-c6f238283b27 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:40.555295 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2ba32346-88be-48ea-a59f-c6f238283b27 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:40.565613 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2ba32346-88be-48ea-a59f-c6f238283b27 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:40.567623 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2ba32346-88be-48ea-a59f-c6f238283b27 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:40.568802 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2ba32346-88be-48ea-a59f-c6f238283b27 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1738 microversion: 2.20 time: 0.211810 Jul 04 04:19:40.569359 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 278/572] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:40 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:41.587094 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-495ce003-6eaf-44ce-81f5-1876b92ebb64 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:41.588359 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-495ce003-6eaf-44ce-81f5-1876b92ebb64 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:41.594456 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=37 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:19:41.596762 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-495ce003-6eaf-44ce-81f5-1876b92ebb64 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:41.597517 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-495ce003-6eaf-44ce-81f5-1876b92ebb64 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:41.598201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-495ce003-6eaf-44ce-81f5-1876b92ebb64 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:41.598660 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-495ce003-6eaf-44ce-81f5-1876b92ebb64 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:41.767173 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-495ce003-6eaf-44ce-81f5-1876b92ebb64 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:41.776046 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-495ce003-6eaf-44ce-81f5-1876b92ebb64 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:41.777745 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-495ce003-6eaf-44ce-81f5-1876b92ebb64 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:41.778952 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-495ce003-6eaf-44ce-81f5-1876b92ebb64 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1738 microversion: 2.20 time: 0.195892 Jul 04 04:19:41.779678 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 295/573] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:41 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:42.796433 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a89db1bd-8222-4b6c-a883-f42d6ae77969 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:42.797266 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a89db1bd-8222-4b6c-a883-f42d6ae77969 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:42.807036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a89db1bd-8222-4b6c-a883-f42d6ae77969 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:42.807514 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a89db1bd-8222-4b6c-a883-f42d6ae77969 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:42.808582 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a89db1bd-8222-4b6c-a883-f42d6ae77969 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:42.809046 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a89db1bd-8222-4b6c-a883-f42d6ae77969 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:42.978410 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a89db1bd-8222-4b6c-a883-f42d6ae77969 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:42.990727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a89db1bd-8222-4b6c-a883-f42d6ae77969 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:42.992228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a89db1bd-8222-4b6c-a883-f42d6ae77969 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:42.993412 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a89db1bd-8222-4b6c-a883-f42d6ae77969 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1738 microversion: 2.20 time: 0.201013 Jul 04 04:19:42.994362 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 279/574] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:42 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:43.282184 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 04:19:43.282353 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Mon Jul 4 04:19:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 04:19:44.019894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7ef8a138-a535-40f5-b667-888f01327834 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:44.021110 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7ef8a138-a535-40f5-b667-888f01327834 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:44.028769 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7ef8a138-a535-40f5-b667-888f01327834 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:44.029215 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7ef8a138-a535-40f5-b667-888f01327834 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:44.029989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7ef8a138-a535-40f5-b667-888f01327834 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:44.030452 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7ef8a138-a535-40f5-b667-888f01327834 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:44.163764 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7ef8a138-a535-40f5-b667-888f01327834 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:44.172171 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7ef8a138-a535-40f5-b667-888f01327834 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:44.173651 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7ef8a138-a535-40f5-b667-888f01327834 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:44.174841 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7ef8a138-a535-40f5-b667-888f01327834 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1738 microversion: 2.20 time: 0.159775 Jul 04 04:19:44.175407 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 296/575] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:44 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:45.193589 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0f007046-4843-4d5f-befc-63622f811cb2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:45.194291 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0f007046-4843-4d5f-befc-63622f811cb2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:45.201857 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f007046-4843-4d5f-befc-63622f811cb2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:45.202314 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f007046-4843-4d5f-befc-63622f811cb2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:45.205137 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f007046-4843-4d5f-befc-63622f811cb2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:45.205781 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f007046-4843-4d5f-befc-63622f811cb2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:45.413519 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f007046-4843-4d5f-befc-63622f811cb2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:45.421945 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f007046-4843-4d5f-befc-63622f811cb2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:45.423509 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f007046-4843-4d5f-befc-63622f811cb2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:45.424688 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0f007046-4843-4d5f-befc-63622f811cb2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1720 microversion: 2.20 time: 0.235182 Jul 04 04:19:45.425255 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 280/576] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:45 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1720 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:45.909327 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b58794da-2ba8-4c81-afe7-bf1936012c5b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:19:45.910349 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b58794da-2ba8-4c81-afe7-bf1936012c5b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:45.917556 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b58794da-2ba8-4c81-afe7-bf1936012c5b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:45.918015 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b58794da-2ba8-4c81-afe7-bf1936012c5b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:45.918812 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b58794da-2ba8-4c81-afe7-bf1936012c5b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:45.919251 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b58794da-2ba8-4c81-afe7-bf1936012c5b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:45.943201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.objects.instance [None req-b58794da-2ba8-4c81-afe7-bf1936012c5b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lazy-loading 'flavor' on Instance uuid cfaa8d9e-b400-45d9-a635-3916ec760c32 {{(pid=117875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:19:46.088920 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b58794da-2ba8-4c81-afe7-bf1936012c5b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "POST /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/action" status: 200 len: 32 microversion: 2.1 time: 0.186441 Jul 04 04:19:46.089543 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 297/577] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 4 04:19:45 2022] POST /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 04:19:46.099036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bee74519-a479-484a-b8a3-7bc8986e1c06 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:46.099642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bee74519-a479-484a-b8a3-7bc8986e1c06 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:46.105756 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bee74519-a479-484a-b8a3-7bc8986e1c06 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:46.106208 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bee74519-a479-484a-b8a3-7bc8986e1c06 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:46.107011 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bee74519-a479-484a-b8a3-7bc8986e1c06 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:46.107445 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bee74519-a479-484a-b8a3-7bc8986e1c06 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:46.256899 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bee74519-a479-484a-b8a3-7bc8986e1c06 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:46.272705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bee74519-a479-484a-b8a3-7bc8986e1c06 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.177389 Jul 04 04:19:46.273691 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 281/578] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:46 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:46.448247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-71eb1edb-5a30-4434-be6d-471f06d243d5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:46.449303 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-71eb1edb-5a30-4434-be6d-471f06d243d5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:46.459412 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-71eb1edb-5a30-4434-be6d-471f06d243d5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:46.460040 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-71eb1edb-5a30-4434-be6d-471f06d243d5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:46.461199 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-71eb1edb-5a30-4434-be6d-471f06d243d5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:46.461784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-71eb1edb-5a30-4434-be6d-471f06d243d5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:46.609262 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-71eb1edb-5a30-4434-be6d-471f06d243d5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:46.622151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-71eb1edb-5a30-4434-be6d-471f06d243d5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:46.624307 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-71eb1edb-5a30-4434-be6d-471f06d243d5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:46.625938 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-71eb1edb-5a30-4434-be6d-471f06d243d5 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1720 microversion: 2.20 time: 0.185105 Jul 04 04:19:46.626692 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 298/579] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:46 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:47.292938 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b8549b73-6e63-444e-b7c4-ccd4c8dc6231 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:47.293586 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b8549b73-6e63-444e-b7c4-ccd4c8dc6231 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:47.301631 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b8549b73-6e63-444e-b7c4-ccd4c8dc6231 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:47.302111 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b8549b73-6e63-444e-b7c4-ccd4c8dc6231 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:47.302941 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b8549b73-6e63-444e-b7c4-ccd4c8dc6231 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:47.303371 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b8549b73-6e63-444e-b7c4-ccd4c8dc6231 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:47.512131 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b8549b73-6e63-444e-b7c4-ccd4c8dc6231 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:47.524051 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b8549b73-6e63-444e-b7c4-ccd4c8dc6231 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.234724 Jul 04 04:19:47.525119 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 282/580] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:47 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:47.645421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a0d9d2c9-b124-42f5-823f-2d033921cc2e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:47.646069 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a0d9d2c9-b124-42f5-823f-2d033921cc2e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:47.652698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a0d9d2c9-b124-42f5-823f-2d033921cc2e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:47.653161 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a0d9d2c9-b124-42f5-823f-2d033921cc2e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:47.653928 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a0d9d2c9-b124-42f5-823f-2d033921cc2e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:47.654392 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a0d9d2c9-b124-42f5-823f-2d033921cc2e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:47.795522 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a0d9d2c9-b124-42f5-823f-2d033921cc2e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:47.804297 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a0d9d2c9-b124-42f5-823f-2d033921cc2e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:47.806144 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a0d9d2c9-b124-42f5-823f-2d033921cc2e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:47.807352 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a0d9d2c9-b124-42f5-823f-2d033921cc2e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1720 microversion: 2.20 time: 0.166606 Jul 04 04:19:47.807914 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 299/581] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:47 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 04:19:48.541304 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-71e45eea-25bb-41d5-a8f4-52466ffec93f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:48.541898 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-71e45eea-25bb-41d5-a8f4-52466ffec93f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:48.548920 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71e45eea-25bb-41d5-a8f4-52466ffec93f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:48.549647 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71e45eea-25bb-41d5-a8f4-52466ffec93f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:48.550495 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71e45eea-25bb-41d5-a8f4-52466ffec93f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:48.550916 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71e45eea-25bb-41d5-a8f4-52466ffec93f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:48.699290 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-71e45eea-25bb-41d5-a8f4-52466ffec93f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:48.707630 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-71e45eea-25bb-41d5-a8f4-52466ffec93f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.170311 Jul 04 04:19:48.708231 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 283/582] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:48 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:48.830788 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f0571536-c095-4a5d-9121-149c04a5569f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:48.831647 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f0571536-c095-4a5d-9121-149c04a5569f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:48.842740 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f0571536-c095-4a5d-9121-149c04a5569f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:48.843485 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f0571536-c095-4a5d-9121-149c04a5569f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:48.844796 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f0571536-c095-4a5d-9121-149c04a5569f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:48.845723 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f0571536-c095-4a5d-9121-149c04a5569f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:48.981336 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f0571536-c095-4a5d-9121-149c04a5569f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:48.996474 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f0571536-c095-4a5d-9121-149c04a5569f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:48.999045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f0571536-c095-4a5d-9121-149c04a5569f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:49.000887 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-f0571536-c095-4a5d-9121-149c04a5569f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1663 microversion: 2.20 time: 0.176974 Jul 04 04:19:49.002514 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 300/583] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:48 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1663 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:49.019717 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c4c9313e-24c5-4778-a14c-c304d6777f4e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c09cea1d-7f6d-4be4-8c73-dec8b6964fd8"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:19:49.020844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c4c9313e-24c5-4778-a14c-c304d6777f4e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:49.027584 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4c9313e-24c5-4778-a14c-c304d6777f4e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:49.028031 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4c9313e-24c5-4778-a14c-c304d6777f4e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:49.028796 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4c9313e-24c5-4778-a14c-c304d6777f4e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:49.029241 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c4c9313e-24c5-4778-a14c-c304d6777f4e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:49.339925 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c4c9313e-24c5-4778-a14c-c304d6777f4e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "POST /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.323877 Jul 04 04:19:49.340860 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 284/584] 10.222.0.16 () {62 vars in 1363 bytes} [Mon Jul 4 04:19:49 2022] POST /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:19:49.457323 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e5c8044a-5f09-478b-9f24-63704ced60ba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:19:49.457883 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e5c8044a-5f09-478b-9f24-63704ced60ba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:49.464108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e5c8044a-5f09-478b-9f24-63704ced60ba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:49.464549 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e5c8044a-5f09-478b-9f24-63704ced60ba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:49.465306 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e5c8044a-5f09-478b-9f24-63704ced60ba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:49.465727 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e5c8044a-5f09-478b-9f24-63704ced60ba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:49.605834 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e5c8044a-5f09-478b-9f24-63704ced60ba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "POST /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/action" status: 202 len: 0 microversion: 2.20 time: 0.152583 Jul 04 04:19:49.606357 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 301/585] 10.222.0.16 () {62 vars in 1318 bytes} [Mon Jul 4 04:19:49 2022] POST /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:19:49.615020 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e7d355b6-1d25-4213-9c2c-e15887466cac tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:49.615633 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e7d355b6-1d25-4213-9c2c-e15887466cac tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:49.622982 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7d355b6-1d25-4213-9c2c-e15887466cac tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:49.623465 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7d355b6-1d25-4213-9c2c-e15887466cac tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:49.624688 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7d355b6-1d25-4213-9c2c-e15887466cac tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:49.625128 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7d355b6-1d25-4213-9c2c-e15887466cac tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:49.725458 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-40c8a1c3-066f-45c7-b2e7-fc891d56b3f0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:49.726146 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-40c8a1c3-066f-45c7-b2e7-fc891d56b3f0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:49.732729 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-40c8a1c3-066f-45c7-b2e7-fc891d56b3f0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:49.733263 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-40c8a1c3-066f-45c7-b2e7-fc891d56b3f0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:49.734101 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-40c8a1c3-066f-45c7-b2e7-fc891d56b3f0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:49.734631 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-40c8a1c3-066f-45c7-b2e7-fc891d56b3f0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:49.760298 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e7d355b6-1d25-4213-9c2c-e15887466cac tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:49.772382 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e7d355b6-1d25-4213-9c2c-e15887466cac tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:49.775487 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e7d355b6-1d25-4213-9c2c-e15887466cac tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:49.777294 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e7d355b6-1d25-4213-9c2c-e15887466cac tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1749 microversion: 2.20 time: 0.166507 Jul 04 04:19:49.779493 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 285/586] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:49 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:49.867299 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-ed84d287-b3c1-410f-b5d0-503b08a6cec4 req-beb219fa-27dd-45ea-b36d-298be996d631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e151ec-4f75-4bfe-8c27-3d6ac7c72453", "name": "network-vif-unplugged", "status": "completed", "tag": "72e623a1-47a8-4ba4-ae5c-a1c4eb8869fc"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:19:49.882109 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-40c8a1c3-066f-45c7-b2e7-fc891d56b3f0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:49.889310 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ed84d287-b3c1-410f-b5d0-503b08a6cec4 req-beb219fa-27dd-45ea-b36d-298be996d631 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:49.889822 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ed84d287-b3c1-410f-b5d0-503b08a6cec4 req-beb219fa-27dd-45ea-b36d-298be996d631 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:49.892617 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-40c8a1c3-066f-45c7-b2e7-fc891d56b3f0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.171031 Jul 04 04:19:49.894104 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 302/587] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:49 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:49.902611 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.compute.server_external_events [req-ed84d287-b3c1-410f-b5d0-503b08a6cec4 req-beb219fa-27dd-45ea-b36d-298be996d631 service nova] Unable to find a host for instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453. Dropping event network-vif-unplugged {{(pid=117877) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 04 04:19:49.903659 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-ed84d287-b3c1-410f-b5d0-503b08a6cec4 req-beb219fa-27dd-45ea-b36d-298be996d631 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040374 Jul 04 04:19:49.904406 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 286/588] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 04 04:19:50.796531 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-537bcbfa-2d50-420a-b183-d96637788a9d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:50.797132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-537bcbfa-2d50-420a-b183-d96637788a9d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:50.803601 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-537bcbfa-2d50-420a-b183-d96637788a9d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:50.804022 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-537bcbfa-2d50-420a-b183-d96637788a9d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:50.804812 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-537bcbfa-2d50-420a-b183-d96637788a9d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:50.805240 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-537bcbfa-2d50-420a-b183-d96637788a9d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:50.910948 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-33fbab6a-df23-4635-a852-fc65bb3ba8da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:50.911537 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-33fbab6a-df23-4635-a852-fc65bb3ba8da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:50.918199 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33fbab6a-df23-4635-a852-fc65bb3ba8da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:50.918689 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33fbab6a-df23-4635-a852-fc65bb3ba8da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:50.919488 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33fbab6a-df23-4635-a852-fc65bb3ba8da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:50.919920 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33fbab6a-df23-4635-a852-fc65bb3ba8da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:50.945617 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-537bcbfa-2d50-420a-b183-d96637788a9d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:50.949272 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:19:50.955680 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-537bcbfa-2d50-420a-b183-d96637788a9d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:50.957171 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-537bcbfa-2d50-420a-b183-d96637788a9d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:50.958352 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-537bcbfa-2d50-420a-b183-d96637788a9d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1749 microversion: 2.20 time: 0.165865 Jul 04 04:19:50.958939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 303/589] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:50 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:51.063847 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-33fbab6a-df23-4635-a852-fc65bb3ba8da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:51.072415 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-33fbab6a-df23-4635-a852-fc65bb3ba8da tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.165848 Jul 04 04:19:51.073018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 287/590] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:50 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:19:51.977580 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d9bd5ffa-0cb0-44f3-bf45-8d868b854fc8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:51.978171 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d9bd5ffa-0cb0-44f3-bf45-8d868b854fc8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:51.986923 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d9bd5ffa-0cb0-44f3-bf45-8d868b854fc8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:51.987469 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d9bd5ffa-0cb0-44f3-bf45-8d868b854fc8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:51.988238 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d9bd5ffa-0cb0-44f3-bf45-8d868b854fc8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:51.988665 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d9bd5ffa-0cb0-44f3-bf45-8d868b854fc8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:52.091460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-80e856ae-58c9-4aaf-99e8-86e344c1d413 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:52.092184 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-80e856ae-58c9-4aaf-99e8-86e344c1d413 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:52.099009 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80e856ae-58c9-4aaf-99e8-86e344c1d413 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:52.099569 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80e856ae-58c9-4aaf-99e8-86e344c1d413 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:52.100422 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80e856ae-58c9-4aaf-99e8-86e344c1d413 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:52.100845 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80e856ae-58c9-4aaf-99e8-86e344c1d413 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:52.132643 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d9bd5ffa-0cb0-44f3-bf45-8d868b854fc8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:52.141860 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d9bd5ffa-0cb0-44f3-bf45-8d868b854fc8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:52.143713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d9bd5ffa-0cb0-44f3-bf45-8d868b854fc8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:52.145038 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d9bd5ffa-0cb0-44f3-bf45-8d868b854fc8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1751 microversion: 2.20 time: 0.171571 Jul 04 04:19:52.145626 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 304/591] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:51 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:52.232594 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-80e856ae-58c9-4aaf-99e8-86e344c1d413 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:52.240973 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-80e856ae-58c9-4aaf-99e8-86e344c1d413 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.155095 Jul 04 04:19:52.241519 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 288/592] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:52 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:53.163936 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f8870e80-1992-4180-9d22-2268143a1ca2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:53.164696 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f8870e80-1992-4180-9d22-2268143a1ca2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:53.171716 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f8870e80-1992-4180-9d22-2268143a1ca2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:53.172089 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f8870e80-1992-4180-9d22-2268143a1ca2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:53.172867 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f8870e80-1992-4180-9d22-2268143a1ca2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:53.173317 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f8870e80-1992-4180-9d22-2268143a1ca2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:53.258638 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-895c385e-e6c6-4c52-aaa5-12b5f04acd1d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:53.259259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-895c385e-e6c6-4c52-aaa5-12b5f04acd1d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:53.266570 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-895c385e-e6c6-4c52-aaa5-12b5f04acd1d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:53.267058 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-895c385e-e6c6-4c52-aaa5-12b5f04acd1d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:53.269508 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-895c385e-e6c6-4c52-aaa5-12b5f04acd1d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:53.269932 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-895c385e-e6c6-4c52-aaa5-12b5f04acd1d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:53.274738 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:19:53.324283 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f8870e80-1992-4180-9d22-2268143a1ca2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:53.333154 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f8870e80-1992-4180-9d22-2268143a1ca2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:53.335397 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f8870e80-1992-4180-9d22-2268143a1ca2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:53.336861 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-f8870e80-1992-4180-9d22-2268143a1ca2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.176881 Jul 04 04:19:53.337751 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 305/593] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:53 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:53.416897 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-895c385e-e6c6-4c52-aaa5-12b5f04acd1d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:53.424964 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-895c385e-e6c6-4c52-aaa5-12b5f04acd1d tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.170317 Jul 04 04:19:53.425462 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 289/594] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:53 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:19:54.355747 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c6673db4-b65d-479e-837a-f7401c412643 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:54.356364 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c6673db4-b65d-479e-837a-f7401c412643 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:54.363955 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c6673db4-b65d-479e-837a-f7401c412643 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:54.364410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c6673db4-b65d-479e-837a-f7401c412643 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:54.365179 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c6673db4-b65d-479e-837a-f7401c412643 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:54.365612 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c6673db4-b65d-479e-837a-f7401c412643 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:54.444494 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c359ffaa-e111-4c79-91b1-c04851f45e1e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:54.445515 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c359ffaa-e111-4c79-91b1-c04851f45e1e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:54.454082 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c359ffaa-e111-4c79-91b1-c04851f45e1e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:54.455323 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c359ffaa-e111-4c79-91b1-c04851f45e1e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:54.456855 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c359ffaa-e111-4c79-91b1-c04851f45e1e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:54.457808 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c359ffaa-e111-4c79-91b1-c04851f45e1e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:54.524396 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c6673db4-b65d-479e-837a-f7401c412643 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:54.532904 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c6673db4-b65d-479e-837a-f7401c412643 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:54.534781 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c6673db4-b65d-479e-837a-f7401c412643 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:54.535947 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c6673db4-b65d-479e-837a-f7401c412643 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.184411 Jul 04 04:19:54.536515 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 306/595] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:54 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:54.606479 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c359ffaa-e111-4c79-91b1-c04851f45e1e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:54.615401 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c359ffaa-e111-4c79-91b1-c04851f45e1e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.176453 Jul 04 04:19:54.616200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 290/596] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:54 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:55.559031 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d21ebafa-1154-45e2-b53f-c86383215761 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:55.560518 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d21ebafa-1154-45e2-b53f-c86383215761 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:55.569305 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d21ebafa-1154-45e2-b53f-c86383215761 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:55.569754 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d21ebafa-1154-45e2-b53f-c86383215761 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:55.570780 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d21ebafa-1154-45e2-b53f-c86383215761 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:55.571351 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d21ebafa-1154-45e2-b53f-c86383215761 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:55.640701 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0b3c47a3-e6d1-45b5-a0e9-7dcbd2631c41 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:55.641815 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0b3c47a3-e6d1-45b5-a0e9-7dcbd2631c41 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:55.650963 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b3c47a3-e6d1-45b5-a0e9-7dcbd2631c41 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:55.651836 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b3c47a3-e6d1-45b5-a0e9-7dcbd2631c41 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:55.653053 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b3c47a3-e6d1-45b5-a0e9-7dcbd2631c41 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:55.653714 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b3c47a3-e6d1-45b5-a0e9-7dcbd2631c41 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:55.727281 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d21ebafa-1154-45e2-b53f-c86383215761 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:55.735916 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d21ebafa-1154-45e2-b53f-c86383215761 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:55.738795 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d21ebafa-1154-45e2-b53f-c86383215761 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:55.739673 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d21ebafa-1154-45e2-b53f-c86383215761 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.187464 Jul 04 04:19:55.740244 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 307/597] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:55 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:55.795789 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0b3c47a3-e6d1-45b5-a0e9-7dcbd2631c41 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:55.805657 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0b3c47a3-e6d1-45b5-a0e9-7dcbd2631c41 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.175135 Jul 04 04:19:55.806466 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 291/598] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:55 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:56.759163 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-23b8793b-af8c-4c34-90b4-367b1d9ebe53 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:56.759888 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-23b8793b-af8c-4c34-90b4-367b1d9ebe53 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:56.767791 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-23b8793b-af8c-4c34-90b4-367b1d9ebe53 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:56.768504 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-23b8793b-af8c-4c34-90b4-367b1d9ebe53 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:56.769383 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-23b8793b-af8c-4c34-90b4-367b1d9ebe53 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:56.769824 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-23b8793b-af8c-4c34-90b4-367b1d9ebe53 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:56.823507 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2c7d5b88-693e-4ed0-a1df-254e3eb74b16 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:56.824141 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2c7d5b88-693e-4ed0-a1df-254e3eb74b16 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:56.831272 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c7d5b88-693e-4ed0-a1df-254e3eb74b16 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:56.831519 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c7d5b88-693e-4ed0-a1df-254e3eb74b16 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:56.832344 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c7d5b88-693e-4ed0-a1df-254e3eb74b16 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:56.832786 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c7d5b88-693e-4ed0-a1df-254e3eb74b16 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:56.930099 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-23b8793b-af8c-4c34-90b4-367b1d9ebe53 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:56.941891 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-23b8793b-af8c-4c34-90b4-367b1d9ebe53 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:56.943656 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-23b8793b-af8c-4c34-90b4-367b1d9ebe53 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:56.945084 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-23b8793b-af8c-4c34-90b4-367b1d9ebe53 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.189893 Jul 04 04:19:56.946206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 308/599] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:56 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:56.986936 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2c7d5b88-693e-4ed0-a1df-254e3eb74b16 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:56.995006 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2c7d5b88-693e-4ed0-a1df-254e3eb74b16 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.175403 Jul 04 04:19:56.995571 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 292/600] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:56 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:19:57.965051 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-fc754090-4224-456a-bda3-49b7b4f58120 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:57.965795 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-fc754090-4224-456a-bda3-49b7b4f58120 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:57.973196 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fc754090-4224-456a-bda3-49b7b4f58120 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:57.973640 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fc754090-4224-456a-bda3-49b7b4f58120 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:57.974443 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fc754090-4224-456a-bda3-49b7b4f58120 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:57.974891 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fc754090-4224-456a-bda3-49b7b4f58120 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:58.012112 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-32c715de-d7e7-4ed6-b56e-85e7a97a008a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:58.013034 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-32c715de-d7e7-4ed6-b56e-85e7a97a008a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:58.019878 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32c715de-d7e7-4ed6-b56e-85e7a97a008a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:58.020337 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32c715de-d7e7-4ed6-b56e-85e7a97a008a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:58.021088 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32c715de-d7e7-4ed6-b56e-85e7a97a008a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:58.021489 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-32c715de-d7e7-4ed6-b56e-85e7a97a008a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:58.106979 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-fc754090-4224-456a-bda3-49b7b4f58120 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:58.115787 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-fc754090-4224-456a-bda3-49b7b4f58120 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:58.117253 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-fc754090-4224-456a-bda3-49b7b4f58120 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:58.118470 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-fc754090-4224-456a-bda3-49b7b4f58120 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.158176 Jul 04 04:19:58.119039 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 309/601] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:57 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:58.155640 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-32c715de-d7e7-4ed6-b56e-85e7a97a008a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:58.164890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-32c715de-d7e7-4ed6-b56e-85e7a97a008a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.156453 Jul 04 04:19:58.165931 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 293/602] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:58 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:19:59.141264 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-93b2d665-da04-4935-9c10-e6fca615eae6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:59.142360 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-93b2d665-da04-4935-9c10-e6fca615eae6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:59.153621 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-93b2d665-da04-4935-9c10-e6fca615eae6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:59.154490 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-93b2d665-da04-4935-9c10-e6fca615eae6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:59.155854 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-93b2d665-da04-4935-9c10-e6fca615eae6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:59.156584 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-93b2d665-da04-4935-9c10-e6fca615eae6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:59.183557 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aa5907cc-a48f-4a08-be38-b209d59cbc74 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:19:59.184679 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aa5907cc-a48f-4a08-be38-b209d59cbc74 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:19:59.191674 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa5907cc-a48f-4a08-be38-b209d59cbc74 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:59.192200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa5907cc-a48f-4a08-be38-b209d59cbc74 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:59.193056 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa5907cc-a48f-4a08-be38-b209d59cbc74 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:19:59.193551 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa5907cc-a48f-4a08-be38-b209d59cbc74 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:19:59.310965 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-93b2d665-da04-4935-9c10-e6fca615eae6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:59.320204 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-93b2d665-da04-4935-9c10-e6fca615eae6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:59.321694 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-93b2d665-da04-4935-9c10-e6fca615eae6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:59.322918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-93b2d665-da04-4935-9c10-e6fca615eae6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.188752 Jul 04 04:19:59.323665 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 310/603] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:19:59 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:19:59.334556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aa5907cc-a48f-4a08-be38-b209d59cbc74 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:19:59.342714 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aa5907cc-a48f-4a08-be38-b209d59cbc74 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.163658 Jul 04 04:19:59.343281 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 294/604] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:19:59 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:00.341409 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7b67f2fe-d06d-43c8-9fa9-38b8bd676664 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:00.342041 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7b67f2fe-d06d-43c8-9fa9-38b8bd676664 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:00.349439 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7b67f2fe-d06d-43c8-9fa9-38b8bd676664 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:00.349893 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7b67f2fe-d06d-43c8-9fa9-38b8bd676664 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:00.350694 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7b67f2fe-d06d-43c8-9fa9-38b8bd676664 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:00.351167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7b67f2fe-d06d-43c8-9fa9-38b8bd676664 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:00.360490 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a4fd82e1-7e68-4cab-a17f-85f870b535fc tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:00.361136 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a4fd82e1-7e68-4cab-a17f-85f870b535fc tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:00.368719 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4fd82e1-7e68-4cab-a17f-85f870b535fc tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:00.369179 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4fd82e1-7e68-4cab-a17f-85f870b535fc tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:00.369962 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4fd82e1-7e68-4cab-a17f-85f870b535fc tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:00.370453 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4fd82e1-7e68-4cab-a17f-85f870b535fc tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:00.496234 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7b67f2fe-d06d-43c8-9fa9-38b8bd676664 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:00.510565 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7b67f2fe-d06d-43c8-9fa9-38b8bd676664 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:00.512102 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7b67f2fe-d06d-43c8-9fa9-38b8bd676664 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:00.513875 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7b67f2fe-d06d-43c8-9fa9-38b8bd676664 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.176209 Jul 04 04:20:00.514683 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 311/605] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:00 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:00.518887 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a4fd82e1-7e68-4cab-a17f-85f870b535fc tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:00.527432 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a4fd82e1-7e68-4cab-a17f-85f870b535fc tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.170579 Jul 04 04:20:00.528071 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 295/606] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:00 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:01.533418 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7458ba5c-f5fb-4843-a215-0ab0cd1a82eb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:01.534273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7458ba5c-f5fb-4843-a215-0ab0cd1a82eb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:01.543128 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7458ba5c-f5fb-4843-a215-0ab0cd1a82eb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:01.543926 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7458ba5c-f5fb-4843-a215-0ab0cd1a82eb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:01.544914 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7458ba5c-f5fb-4843-a215-0ab0cd1a82eb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:01.545536 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7458ba5c-f5fb-4843-a215-0ab0cd1a82eb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:01.546979 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e2035b18-e231-48db-af6b-b3317f221368 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:01.547635 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e2035b18-e231-48db-af6b-b3317f221368 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:01.555477 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2035b18-e231-48db-af6b-b3317f221368 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:01.556292 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2035b18-e231-48db-af6b-b3317f221368 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:01.557292 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2035b18-e231-48db-af6b-b3317f221368 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:01.558052 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2035b18-e231-48db-af6b-b3317f221368 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:01.696402 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7458ba5c-f5fb-4843-a215-0ab0cd1a82eb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:01.710008 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e2035b18-e231-48db-af6b-b3317f221368 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:01.715374 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7458ba5c-f5fb-4843-a215-0ab0cd1a82eb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:01.716886 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7458ba5c-f5fb-4843-a215-0ab0cd1a82eb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:01.718080 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7458ba5c-f5fb-4843-a215-0ab0cd1a82eb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.188734 Jul 04 04:20:01.719009 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 312/607] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:01 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:01.721092 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e2035b18-e231-48db-af6b-b3317f221368 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.178288 Jul 04 04:20:01.731348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 296/608] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:01 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:02.737037 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e098711b-629c-458c-b900-b076aae25468 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:02.737871 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e098711b-629c-458c-b900-b076aae25468 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:02.738496 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e2c77dae-1710-4f8f-9052-b52e1f2a343e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:02.739107 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e2c77dae-1710-4f8f-9052-b52e1f2a343e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:02.744981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e098711b-629c-458c-b900-b076aae25468 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:02.745488 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e098711b-629c-458c-b900-b076aae25468 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:02.745950 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2c77dae-1710-4f8f-9052-b52e1f2a343e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:02.746416 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e098711b-629c-458c-b900-b076aae25468 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:02.746635 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2c77dae-1710-4f8f-9052-b52e1f2a343e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:02.747024 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e098711b-629c-458c-b900-b076aae25468 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:02.747463 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2c77dae-1710-4f8f-9052-b52e1f2a343e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:02.747870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2c77dae-1710-4f8f-9052-b52e1f2a343e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:02.895235 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e098711b-629c-458c-b900-b076aae25468 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:02.905001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e098711b-629c-458c-b900-b076aae25468 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:02.906496 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e098711b-629c-458c-b900-b076aae25468 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:02.907662 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e098711b-629c-458c-b900-b076aae25468 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.174636 Jul 04 04:20:02.908217 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 313/609] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:02 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:02.913473 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e2c77dae-1710-4f8f-9052-b52e1f2a343e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:02.921653 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e2c77dae-1710-4f8f-9052-b52e1f2a343e tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.187089 Jul 04 04:20:02.922217 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 297/610] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:02 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:03.926472 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-689fdc9a-42b9-41c3-80fe-458b768b3c8f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:03.927086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-689fdc9a-42b9-41c3-80fe-458b768b3c8f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:03.934068 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-689fdc9a-42b9-41c3-80fe-458b768b3c8f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:03.934611 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-689fdc9a-42b9-41c3-80fe-458b768b3c8f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:03.935366 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-689fdc9a-42b9-41c3-80fe-458b768b3c8f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:03.935794 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-689fdc9a-42b9-41c3-80fe-458b768b3c8f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:03.939232 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c5c204d0-cec4-46de-a546-94f35179c5ee tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:03.939836 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c5c204d0-cec4-46de-a546-94f35179c5ee tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:03.946492 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5c204d0-cec4-46de-a546-94f35179c5ee tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:03.946930 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5c204d0-cec4-46de-a546-94f35179c5ee tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:03.947687 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5c204d0-cec4-46de-a546-94f35179c5ee tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:03.948113 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5c204d0-cec4-46de-a546-94f35179c5ee tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:04.092371 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-689fdc9a-42b9-41c3-80fe-458b768b3c8f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:04.105180 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c5c204d0-cec4-46de-a546-94f35179c5ee tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:04.113538 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c5c204d0-cec4-46de-a546-94f35179c5ee tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.177996 Jul 04 04:20:04.113851 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-689fdc9a-42b9-41c3-80fe-458b768b3c8f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:04.116176 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 298/611] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:03 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:04.125286 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-689fdc9a-42b9-41c3-80fe-458b768b3c8f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:04.126656 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-689fdc9a-42b9-41c3-80fe-458b768b3c8f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.204247 Jul 04 04:20:04.127237 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 314/612] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:03 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:05.134948 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6f04529f-e311-494e-b069-427f06da6d09 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:05.135634 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6f04529f-e311-494e-b069-427f06da6d09 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:05.143587 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f04529f-e311-494e-b069-427f06da6d09 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:05.144304 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f04529f-e311-494e-b069-427f06da6d09 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:05.145608 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f6635d93-674c-418f-8465-f64e8051c6ff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:05.146916 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f04529f-e311-494e-b069-427f06da6d09 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:05.147082 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f6635d93-674c-418f-8465-f64e8051c6ff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:05.147684 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f04529f-e311-494e-b069-427f06da6d09 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:05.155330 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f6635d93-674c-418f-8465-f64e8051c6ff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:05.155872 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f6635d93-674c-418f-8465-f64e8051c6ff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:05.156722 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f6635d93-674c-418f-8465-f64e8051c6ff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:05.157364 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f6635d93-674c-418f-8465-f64e8051c6ff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:05.283753 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6f04529f-e311-494e-b069-427f06da6d09 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:05.290602 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f6635d93-674c-418f-8465-f64e8051c6ff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:05.292417 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6f04529f-e311-494e-b069-427f06da6d09 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.161477 Jul 04 04:20:05.292991 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 299/613] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:05 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:20:05.299605 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f6635d93-674c-418f-8465-f64e8051c6ff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:05.301922 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f6635d93-674c-418f-8465-f64e8051c6ff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:05.303592 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-f6635d93-674c-418f-8465-f64e8051c6ff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.162215 Jul 04 04:20:05.304459 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 315/614] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:05 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:06.311219 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a20e5bf8-7ddf-4392-8d1a-7ffad652f4b0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:06.311856 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a20e5bf8-7ddf-4392-8d1a-7ffad652f4b0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:06.319363 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a20e5bf8-7ddf-4392-8d1a-7ffad652f4b0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:06.319817 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a20e5bf8-7ddf-4392-8d1a-7ffad652f4b0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:06.320928 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a20e5bf8-7ddf-4392-8d1a-7ffad652f4b0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:06.321566 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a20e5bf8-7ddf-4392-8d1a-7ffad652f4b0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:06.327501 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-90f8a8b6-3208-4b42-9588-9e9da2e70ce6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:06.327501 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-90f8a8b6-3208-4b42-9588-9e9da2e70ce6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:06.334262 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-90f8a8b6-3208-4b42-9588-9e9da2e70ce6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:06.334723 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-90f8a8b6-3208-4b42-9588-9e9da2e70ce6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:06.335535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-90f8a8b6-3208-4b42-9588-9e9da2e70ce6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:06.335972 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-90f8a8b6-3208-4b42-9588-9e9da2e70ce6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:06.460946 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a20e5bf8-7ddf-4392-8d1a-7ffad652f4b0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:06.469515 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-90f8a8b6-3208-4b42-9588-9e9da2e70ce6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:06.469735 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a20e5bf8-7ddf-4392-8d1a-7ffad652f4b0 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.162577 Jul 04 04:20:06.470270 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 300/615] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:06 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:06.479326 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-90f8a8b6-3208-4b42-9588-9e9da2e70ce6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:06.480941 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-90f8a8b6-3208-4b42-9588-9e9da2e70ce6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:06.482118 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-90f8a8b6-3208-4b42-9588-9e9da2e70ce6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.160416 Jul 04 04:20:06.482701 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 316/616] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:06 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:07.491776 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ac500aef-3d91-4dc8-bb59-7951ea4b7ded tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:07.492772 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ac500aef-3d91-4dc8-bb59-7951ea4b7ded tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:07.504083 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac500aef-3d91-4dc8-bb59-7951ea4b7ded tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:07.504886 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac500aef-3d91-4dc8-bb59-7951ea4b7ded tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:07.505422 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1118115e-2aa5-4253-bb03-678199c72a5f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:07.506283 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac500aef-3d91-4dc8-bb59-7951ea4b7ded tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:07.506420 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-1118115e-2aa5-4253-bb03-678199c72a5f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:07.506518 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac500aef-3d91-4dc8-bb59-7951ea4b7ded tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:07.513649 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1118115e-2aa5-4253-bb03-678199c72a5f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:07.514094 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1118115e-2aa5-4253-bb03-678199c72a5f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:07.514897 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1118115e-2aa5-4253-bb03-678199c72a5f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:07.515383 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1118115e-2aa5-4253-bb03-678199c72a5f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:07.645212 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ac500aef-3d91-4dc8-bb59-7951ea4b7ded tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:07.651746 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-1118115e-2aa5-4253-bb03-678199c72a5f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:07.653879 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ac500aef-3d91-4dc8-bb59-7951ea4b7ded tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.168735 Jul 04 04:20:07.654481 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 301/617] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:07 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:07.660271 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-1118115e-2aa5-4253-bb03-678199c72a5f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:07.661804 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-1118115e-2aa5-4253-bb03-678199c72a5f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:07.663231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-1118115e-2aa5-4253-bb03-678199c72a5f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.165199 Jul 04 04:20:07.663730 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 317/618] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:07 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:08.671347 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3c8e5a4f-e226-4f1b-aab4-2909baece11f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:08.671985 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3c8e5a4f-e226-4f1b-aab4-2909baece11f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:08.678722 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c8e5a4f-e226-4f1b-aab4-2909baece11f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:08.679148 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c8e5a4f-e226-4f1b-aab4-2909baece11f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:08.679934 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c8e5a4f-e226-4f1b-aab4-2909baece11f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:08.680370 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c8e5a4f-e226-4f1b-aab4-2909baece11f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:08.681066 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-0cefa2df-4943-497e-99bd-66b97ddb3367 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:08.681679 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-0cefa2df-4943-497e-99bd-66b97ddb3367 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:08.688472 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0cefa2df-4943-497e-99bd-66b97ddb3367 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:08.688985 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0cefa2df-4943-497e-99bd-66b97ddb3367 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:08.689786 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0cefa2df-4943-497e-99bd-66b97ddb3367 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:08.690226 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0cefa2df-4943-497e-99bd-66b97ddb3367 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:08.816918 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3c8e5a4f-e226-4f1b-aab4-2909baece11f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:08.825344 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3c8e5a4f-e226-4f1b-aab4-2909baece11f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.157939 Jul 04 04:20:08.825925 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 302/619] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:08 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:08.826310 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-0cefa2df-4943-497e-99bd-66b97ddb3367 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:08.835133 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-0cefa2df-4943-497e-99bd-66b97ddb3367 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:08.836620 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-0cefa2df-4943-497e-99bd-66b97ddb3367 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:08.837779 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-0cefa2df-4943-497e-99bd-66b97ddb3367 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.160712 Jul 04 04:20:08.838324 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 318/620] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:08 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 04:20:09.846782 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-883d03b5-4008-49b8-bd2a-2684dc3c8a3f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:09.847767 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-883d03b5-4008-49b8-bd2a-2684dc3c8a3f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:09.855577 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-883d03b5-4008-49b8-bd2a-2684dc3c8a3f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:09.856020 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-883d03b5-4008-49b8-bd2a-2684dc3c8a3f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:09.856400 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-0e7f6ce2-0452-4f8c-842c-2b076f301157 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:09.856855 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-883d03b5-4008-49b8-bd2a-2684dc3c8a3f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:09.857023 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-0e7f6ce2-0452-4f8c-842c-2b076f301157 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:09.857187 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-883d03b5-4008-49b8-bd2a-2684dc3c8a3f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:09.863891 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0e7f6ce2-0452-4f8c-842c-2b076f301157 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:09.864344 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0e7f6ce2-0452-4f8c-842c-2b076f301157 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:09.865152 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0e7f6ce2-0452-4f8c-842c-2b076f301157 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:09.865551 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0e7f6ce2-0452-4f8c-842c-2b076f301157 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:09.988092 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-883d03b5-4008-49b8-bd2a-2684dc3c8a3f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:09.996258 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-883d03b5-4008-49b8-bd2a-2684dc3c8a3f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.156016 Jul 04 04:20:09.997189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 303/621] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:09 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:09.999207 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-0e7f6ce2-0452-4f8c-842c-2b076f301157 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:10.008259 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-0e7f6ce2-0452-4f8c-842c-2b076f301157 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:10.009866 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-0e7f6ce2-0452-4f8c-842c-2b076f301157 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:10.011236 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-0e7f6ce2-0452-4f8c-842c-2b076f301157 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.158846 Jul 04 04:20:10.011973 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 319/622] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:09 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:11.015972 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ab7264ab-9e59-4cfe-a39d-3eb81f5fb990 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:11.016676 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ab7264ab-9e59-4cfe-a39d-3eb81f5fb990 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:11.019604 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=52 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:11.026161 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab7264ab-9e59-4cfe-a39d-3eb81f5fb990 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:11.026632 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab7264ab-9e59-4cfe-a39d-3eb81f5fb990 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:11.027398 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab7264ab-9e59-4cfe-a39d-3eb81f5fb990 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:11.027825 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab7264ab-9e59-4cfe-a39d-3eb81f5fb990 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:11.033020 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ad15bfbf-d752-4e85-a492-0f98f9d7cc97 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:11.033631 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-ad15bfbf-d752-4e85-a492-0f98f9d7cc97 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:11.040666 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ad15bfbf-d752-4e85-a492-0f98f9d7cc97 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:11.041131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ad15bfbf-d752-4e85-a492-0f98f9d7cc97 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:11.041908 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ad15bfbf-d752-4e85-a492-0f98f9d7cc97 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:11.042338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ad15bfbf-d752-4e85-a492-0f98f9d7cc97 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:11.061242 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=100 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:11.166414 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ab7264ab-9e59-4cfe-a39d-3eb81f5fb990 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:11.174986 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ab7264ab-9e59-4cfe-a39d-3eb81f5fb990 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.164330 Jul 04 04:20:11.175558 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 304/623] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:11 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:11.177522 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-ad15bfbf-d752-4e85-a492-0f98f9d7cc97 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:11.187387 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-ad15bfbf-d752-4e85-a492-0f98f9d7cc97 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:11.188907 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-ad15bfbf-d752-4e85-a492-0f98f9d7cc97 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:11.190133 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ad15bfbf-d752-4e85-a492-0f98f9d7cc97 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.161157 Jul 04 04:20:11.190724 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 320/624] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:11 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:12.195012 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2b28827a-4a04-48cd-9e8b-1b38bbdecf01 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:12.195799 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2b28827a-4a04-48cd-9e8b-1b38bbdecf01 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:12.205138 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b28827a-4a04-48cd-9e8b-1b38bbdecf01 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:12.205749 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b28827a-4a04-48cd-9e8b-1b38bbdecf01 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:12.206840 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b28827a-4a04-48cd-9e8b-1b38bbdecf01 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:12.207426 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b28827a-4a04-48cd-9e8b-1b38bbdecf01 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:12.210695 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a9adbdf8-6772-4353-84d0-1a57e3d31b83 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:12.211494 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a9adbdf8-6772-4353-84d0-1a57e3d31b83 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:12.216137 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=54 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:12.222500 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a9adbdf8-6772-4353-84d0-1a57e3d31b83 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:12.222946 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a9adbdf8-6772-4353-84d0-1a57e3d31b83 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:12.223725 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a9adbdf8-6772-4353-84d0-1a57e3d31b83 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:12.224165 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a9adbdf8-6772-4353-84d0-1a57e3d31b83 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:12.340435 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2b28827a-4a04-48cd-9e8b-1b38bbdecf01 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:12.343891 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:12.349533 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2b28827a-4a04-48cd-9e8b-1b38bbdecf01 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.160157 Jul 04 04:20:12.350107 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 305/625] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:12 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:12.356178 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a9adbdf8-6772-4353-84d0-1a57e3d31b83 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:12.364830 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a9adbdf8-6772-4353-84d0-1a57e3d31b83 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:12.366498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a9adbdf8-6772-4353-84d0-1a57e3d31b83 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:12.368037 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a9adbdf8-6772-4353-84d0-1a57e3d31b83 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.162353 Jul 04 04:20:12.368861 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 321/626] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:12 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 04:20:13.367275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-186fc378-1e59-4367-a688-d53a60635137 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:13.367854 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-186fc378-1e59-4367-a688-d53a60635137 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:13.374971 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-186fc378-1e59-4367-a688-d53a60635137 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:13.375424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-186fc378-1e59-4367-a688-d53a60635137 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:13.376189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-186fc378-1e59-4367-a688-d53a60635137 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:13.376630 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-186fc378-1e59-4367-a688-d53a60635137 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:13.393304 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a011e76c-3301-477c-b30c-b53f0d2900c2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:13.394002 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a011e76c-3301-477c-b30c-b53f0d2900c2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:13.401250 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a011e76c-3301-477c-b30c-b53f0d2900c2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:13.401779 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a011e76c-3301-477c-b30c-b53f0d2900c2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:13.402715 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a011e76c-3301-477c-b30c-b53f0d2900c2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:13.403216 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a011e76c-3301-477c-b30c-b53f0d2900c2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:13.513144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-186fc378-1e59-4367-a688-d53a60635137 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:13.521172 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-186fc378-1e59-4367-a688-d53a60635137 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.157860 Jul 04 04:20:13.521965 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 306/627] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:13 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:13.536266 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a011e76c-3301-477c-b30c-b53f0d2900c2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:13.545146 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a011e76c-3301-477c-b30c-b53f0d2900c2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:13.546673 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a011e76c-3301-477c-b30c-b53f0d2900c2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:13.547833 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a011e76c-3301-477c-b30c-b53f0d2900c2 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.158496 Jul 04 04:20:13.548364 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 322/628] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:13 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:14.538698 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c3345dbe-54a6-4a3a-8d65-622f736498fd tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:14.539296 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c3345dbe-54a6-4a3a-8d65-622f736498fd tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:14.549209 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3345dbe-54a6-4a3a-8d65-622f736498fd tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:14.549776 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3345dbe-54a6-4a3a-8d65-622f736498fd tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:14.550967 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3345dbe-54a6-4a3a-8d65-622f736498fd tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:14.551563 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3345dbe-54a6-4a3a-8d65-622f736498fd tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:14.565101 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7755797a-59e2-4a0a-a6a7-e5b8b46390d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:14.565726 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7755797a-59e2-4a0a-a6a7-e5b8b46390d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:14.572629 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7755797a-59e2-4a0a-a6a7-e5b8b46390d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:14.573074 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7755797a-59e2-4a0a-a6a7-e5b8b46390d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:14.573833 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7755797a-59e2-4a0a-a6a7-e5b8b46390d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:14.574262 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7755797a-59e2-4a0a-a6a7-e5b8b46390d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:14.684627 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c3345dbe-54a6-4a3a-8d65-622f736498fd tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:14.692714 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c3345dbe-54a6-4a3a-8d65-622f736498fd tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1734 microversion: 2.1 time: 0.157977 Jul 04 04:20:14.693507 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 307/629] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:14 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:14.711914 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7755797a-59e2-4a0a-a6a7-e5b8b46390d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:14.720383 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7755797a-59e2-4a0a-a6a7-e5b8b46390d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:14.721890 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7755797a-59e2-4a0a-a6a7-e5b8b46390d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:14.723070 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7755797a-59e2-4a0a-a6a7-e5b8b46390d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.161929 Jul 04 04:20:14.723621 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 323/630] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:14 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:15.714598 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6717baf2-519d-4f96-ac7c-fded2b3f6e66 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:15.715644 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6717baf2-519d-4f96-ac7c-fded2b3f6e66 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:15.726407 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6717baf2-519d-4f96-ac7c-fded2b3f6e66 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:15.726873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6717baf2-519d-4f96-ac7c-fded2b3f6e66 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:15.727628 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6717baf2-519d-4f96-ac7c-fded2b3f6e66 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:15.728053 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6717baf2-519d-4f96-ac7c-fded2b3f6e66 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:15.741138 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7bb1296f-cd24-4794-a75b-0bbce6bcc088 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:15.741804 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7bb1296f-cd24-4794-a75b-0bbce6bcc088 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:15.748716 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7bb1296f-cd24-4794-a75b-0bbce6bcc088 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:15.749197 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7bb1296f-cd24-4794-a75b-0bbce6bcc088 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:15.749968 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7bb1296f-cd24-4794-a75b-0bbce6bcc088 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:15.750395 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7bb1296f-cd24-4794-a75b-0bbce6bcc088 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:15.867704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6717baf2-519d-4f96-ac7c-fded2b3f6e66 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:15.876121 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6717baf2-519d-4f96-ac7c-fded2b3f6e66 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1714 microversion: 2.1 time: 0.168340 Jul 04 04:20:15.877003 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 308/631] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:15 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1714 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:15.902986 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7bb1296f-cd24-4794-a75b-0bbce6bcc088 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:15.912069 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7bb1296f-cd24-4794-a75b-0bbce6bcc088 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:15.913583 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7bb1296f-cd24-4794-a75b-0bbce6bcc088 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:15.914833 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7bb1296f-cd24-4794-a75b-0bbce6bcc088 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.177666 Jul 04 04:20:15.915539 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 324/632] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:15 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:15.934615 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-50971d2e-7fdf-4b67-b2ed-cc866cb28d8f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:15.935228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-50971d2e-7fdf-4b67-b2ed-cc866cb28d8f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:15.941748 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50971d2e-7fdf-4b67-b2ed-cc866cb28d8f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:15.942499 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50971d2e-7fdf-4b67-b2ed-cc866cb28d8f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:15.943498 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50971d2e-7fdf-4b67-b2ed-cc866cb28d8f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:15.943912 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50971d2e-7fdf-4b67-b2ed-cc866cb28d8f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:16.069646 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-50971d2e-7fdf-4b67-b2ed-cc866cb28d8f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] HTTP exception thrown: Cannot 'detach_volume' instance cfaa8d9e-b400-45d9-a635-3916ec760c32 while it is in vm_state rescued Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-50971d2e-7fdf-4b67-b2ed-cc866cb28d8f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Request method failure captured: Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/os-volume_attachments/a55e874c-f8a8-43e8-b2f9-9ae7f0b91f70 HTTP/1.1 Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmktGFBnwxVIACZValM9F_vrhCgFSRvMfNRwtdrHKuyEsmF4aiq464pUWCHoMBUPvBNYcADpX-2vxT_KraK3ReDT4FVftgwsiJAXYCECV12XOYlbBVQ1ZYULfr056xZkZOy4W69n1sC16SqMpBplnzVOrH2eQH8bDSp-6KdyeIq-sHU Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 7ea328a1154a4a9a955e411f7eab0aa9 Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1922475267 Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:20:16.071336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:20:16.072867 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ea328a1154a4a9a955e411f7eab0aa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ea328a1154a4a9a955e411f7eab0aa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ea328a1154a4a9a955e411f7eab0aa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ea328a1154a4a9a955e411f7eab0aa9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:20:16.072867 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1922475267 Jul 04 04:20:16.072867 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 7ea328a1154a4a9a955e411f7eab0aa9 Jul 04 04:20:16.072867 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1922475267 Jul 04 04:20:16.072867 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-ServerRescueNegativeTestJSON-1922475267-project Jul 04 04:20:16.072867 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:20:16.072867 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:20:16.072867 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: dca54bc220104e79aa727f30399f3411 Jul 04 04:20:16.072867 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1922475267-project Jul 04 04:20:16.072867 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:20:16.072867 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Cannot 'detach_volume' instance cfaa8d9e-b400-45d9-a635-3916ec760c32 while it is in vm_state rescued Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'server_id': 'cfaa8d9e-b400-45d9-a635-3916ec760c32', 'id': 'a55e874c-f8a8-43e8-b2f9-9ae7f0b91f70'} Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cfaa8d9e-b400-45d9-a635-3916ec760c32 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:20:16.073544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:20:16.074942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 04 04:20:16.074942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 04 04:20:16.074942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 04 04:20:16.074942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 04 04:20:16.074942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance cfaa8d9e-b400-45d9-a635-3916ec760c32 while it is in vm_state rescued Jul 04 04:20:16.074942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:20:16.074942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:20:16.074942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:20:16.074942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:20:16.074942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:20:16.074942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:20:16.074942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:20:16.074942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:20:16.074942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance cfaa8d9e-b400-45d9-a635-3916ec760c32 while it is in vm_state rescued Jul 04 04:20:16.074942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:20:16.074942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-50971d2e-7fdf-4b67-b2ed-cc866cb28d8f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Returning 409 to user: Cannot 'detach_volume' instance cfaa8d9e-b400-45d9-a635-3916ec760c32 while it is in vm_state rescued {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:20:16.076226 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-50971d2e-7fdf-4b67-b2ed-cc866cb28d8f tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/os-volume_attachments/a55e874c-f8a8-43e8-b2f9-9ae7f0b91f70" status: 409 len: 152 microversion: 2.1 time: 0.142378 Jul 04 04:20:16.076226 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 309/633] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jul 4 04:20:15 2022] DELETE /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/os-volume_attachments/a55e874c-f8a8-43e8-b2f9-9ae7f0b91f70 => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 04 04:20:16.082151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-6ddd098a-ef9f-4ebc-ac47-8bea2d072057 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:20:16.082712 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-6ddd098a-ef9f-4ebc-ac47-8bea2d072057 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:16.089357 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6ddd098a-ef9f-4ebc-ac47-8bea2d072057 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:16.089792 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6ddd098a-ef9f-4ebc-ac47-8bea2d072057 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:16.090569 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6ddd098a-ef9f-4ebc-ac47-8bea2d072057 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:16.091047 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6ddd098a-ef9f-4ebc-ac47-8bea2d072057 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:16.164485 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-6ddd098a-ef9f-4ebc-ac47-8bea2d072057 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "POST /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/action" status: 202 len: 0 microversion: 2.1 time: 0.086172 Jul 04 04:20:16.166217 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 325/634] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 4 04:20:16 2022] POST /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 04:20:16.174564 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eeecd036-3910-4022-8e71-c24290067351 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:16.175164 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eeecd036-3910-4022-8e71-c24290067351 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:16.182082 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eeecd036-3910-4022-8e71-c24290067351 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:16.182559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eeecd036-3910-4022-8e71-c24290067351 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:16.183558 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eeecd036-3910-4022-8e71-c24290067351 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:16.184173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eeecd036-3910-4022-8e71-c24290067351 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:16.414853 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eeecd036-3910-4022-8e71-c24290067351 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:16.423079 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eeecd036-3910-4022-8e71-c24290067351 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1722 microversion: 2.1 time: 0.252501 Jul 04 04:20:16.423627 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 310/635] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:16 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:16.935614 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9d8a0006-8490-41de-a4fe-dab62e36e43b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:16.936484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-9d8a0006-8490-41de-a4fe-dab62e36e43b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:16.944640 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9d8a0006-8490-41de-a4fe-dab62e36e43b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:16.945232 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9d8a0006-8490-41de-a4fe-dab62e36e43b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:16.946340 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9d8a0006-8490-41de-a4fe-dab62e36e43b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:16.946932 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9d8a0006-8490-41de-a4fe-dab62e36e43b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:17.086664 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9d8a0006-8490-41de-a4fe-dab62e36e43b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:17.095743 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9d8a0006-8490-41de-a4fe-dab62e36e43b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:17.097241 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9d8a0006-8490-41de-a4fe-dab62e36e43b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:17.098427 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9d8a0006-8490-41de-a4fe-dab62e36e43b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.168966 Jul 04 04:20:17.098985 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 326/636] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:16 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:17.445193 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2c4fb642-16e4-4062-8ce5-221cdc6ee155 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:17.446531 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2c4fb642-16e4-4062-8ce5-221cdc6ee155 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:17.457638 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c4fb642-16e4-4062-8ce5-221cdc6ee155 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:17.458421 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c4fb642-16e4-4062-8ce5-221cdc6ee155 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:17.459702 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c4fb642-16e4-4062-8ce5-221cdc6ee155 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:17.460472 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c4fb642-16e4-4062-8ce5-221cdc6ee155 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:17.609858 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2c4fb642-16e4-4062-8ce5-221cdc6ee155 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:17.618309 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2c4fb642-16e4-4062-8ce5-221cdc6ee155 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1722 microversion: 2.1 time: 0.179965 Jul 04 04:20:17.618918 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 311/637] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:17 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:18.119704 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-266a3bff-a08b-4529-b9e8-36f92cb9ec38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:18.120620 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-266a3bff-a08b-4529-b9e8-36f92cb9ec38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:18.130780 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-266a3bff-a08b-4529-b9e8-36f92cb9ec38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:18.131459 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-266a3bff-a08b-4529-b9e8-36f92cb9ec38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:18.132912 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-266a3bff-a08b-4529-b9e8-36f92cb9ec38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:18.133379 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-266a3bff-a08b-4529-b9e8-36f92cb9ec38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:18.270514 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-266a3bff-a08b-4529-b9e8-36f92cb9ec38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:18.279639 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-266a3bff-a08b-4529-b9e8-36f92cb9ec38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:18.281118 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-266a3bff-a08b-4529-b9e8-36f92cb9ec38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:18.282354 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-266a3bff-a08b-4529-b9e8-36f92cb9ec38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.168792 Jul 04 04:20:18.282855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 327/638] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:18 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:18.638325 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fc42df7c-ab4c-43be-9932-fe89399cba48 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:18.638983 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fc42df7c-ab4c-43be-9932-fe89399cba48 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:18.646075 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc42df7c-ab4c-43be-9932-fe89399cba48 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:18.646567 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc42df7c-ab4c-43be-9932-fe89399cba48 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:18.647334 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc42df7c-ab4c-43be-9932-fe89399cba48 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:18.647767 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc42df7c-ab4c-43be-9932-fe89399cba48 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:18.782246 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fc42df7c-ab4c-43be-9932-fe89399cba48 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:18.793231 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fc42df7c-ab4c-43be-9932-fe89399cba48 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1722 microversion: 2.1 time: 0.159244 Jul 04 04:20:18.793782 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 312/639] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:18 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:19.304803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5245012d-6ef7-4a93-900b-ab8daf984c82 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:19.305728 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5245012d-6ef7-4a93-900b-ab8daf984c82 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:19.316898 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5245012d-6ef7-4a93-900b-ab8daf984c82 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:19.317648 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5245012d-6ef7-4a93-900b-ab8daf984c82 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:19.318988 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5245012d-6ef7-4a93-900b-ab8daf984c82 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:19.319714 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5245012d-6ef7-4a93-900b-ab8daf984c82 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:19.472626 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5245012d-6ef7-4a93-900b-ab8daf984c82 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:19.483578 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5245012d-6ef7-4a93-900b-ab8daf984c82 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:19.485078 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5245012d-6ef7-4a93-900b-ab8daf984c82 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:19.486269 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5245012d-6ef7-4a93-900b-ab8daf984c82 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.188148 Jul 04 04:20:19.486880 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 328/640] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:19 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:19.814474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-31d825b8-b3df-4534-a9e7-f328f6237a5a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:19.815464 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-31d825b8-b3df-4534-a9e7-f328f6237a5a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:19.827000 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-31d825b8-b3df-4534-a9e7-f328f6237a5a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:19.827740 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-31d825b8-b3df-4534-a9e7-f328f6237a5a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:19.829046 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-31d825b8-b3df-4534-a9e7-f328f6237a5a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:19.829766 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-31d825b8-b3df-4534-a9e7-f328f6237a5a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:19.967933 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-31d825b8-b3df-4534-a9e7-f328f6237a5a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:19.975989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-31d825b8-b3df-4534-a9e7-f328f6237a5a tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1722 microversion: 2.1 time: 0.167923 Jul 04 04:20:19.976524 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 313/641] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:19 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:20.506316 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-2d05b887-69ea-4467-afbb-236bd76aa18e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:20.506966 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-2d05b887-69ea-4467-afbb-236bd76aa18e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:20.513792 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2d05b887-69ea-4467-afbb-236bd76aa18e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:20.514228 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2d05b887-69ea-4467-afbb-236bd76aa18e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:20.515018 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2d05b887-69ea-4467-afbb-236bd76aa18e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:20.515449 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2d05b887-69ea-4467-afbb-236bd76aa18e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:20.671088 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-2d05b887-69ea-4467-afbb-236bd76aa18e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:20.680516 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-2d05b887-69ea-4467-afbb-236bd76aa18e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:20.681952 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-2d05b887-69ea-4467-afbb-236bd76aa18e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:20.683285 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-2d05b887-69ea-4467-afbb-236bd76aa18e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.181617 Jul 04 04:20:20.684156 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 329/642] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:20 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:20.995727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-23edd503-c5c5-4845-9dd4-1b48728d35e5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:20.996557 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-23edd503-c5c5-4845-9dd4-1b48728d35e5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:21.006322 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-23edd503-c5c5-4845-9dd4-1b48728d35e5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:21.007012 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-23edd503-c5c5-4845-9dd4-1b48728d35e5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:21.008185 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-23edd503-c5c5-4845-9dd4-1b48728d35e5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:21.008809 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-23edd503-c5c5-4845-9dd4-1b48728d35e5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:21.157706 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-23edd503-c5c5-4845-9dd4-1b48728d35e5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:21.168414 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-23edd503-c5c5-4845-9dd4-1b48728d35e5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1722 microversion: 2.1 time: 0.178422 Jul 04 04:20:21.168955 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 314/643] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:20 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:21.705491 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-255bc911-f6cb-4f4b-9b1e-6573061fadb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:21.706529 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-255bc911-f6cb-4f4b-9b1e-6573061fadb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:21.717729 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-255bc911-f6cb-4f4b-9b1e-6573061fadb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:21.718570 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-255bc911-f6cb-4f4b-9b1e-6573061fadb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:21.719811 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-255bc911-f6cb-4f4b-9b1e-6573061fadb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:21.720540 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-255bc911-f6cb-4f4b-9b1e-6573061fadb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:21.860501 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-255bc911-f6cb-4f4b-9b1e-6573061fadb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:21.871780 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-255bc911-f6cb-4f4b-9b1e-6573061fadb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:21.873251 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-255bc911-f6cb-4f4b-9b1e-6573061fadb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:21.875203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-255bc911-f6cb-4f4b-9b1e-6573061fadb4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.176141 Jul 04 04:20:21.875773 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 330/644] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:21 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:22.048433 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-7d0257b4-824c-47c9-a2df-ce24db0dab8e req-8dd9e373-8520-4a79-b9b8-118d4f97ad50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e151ec-4f75-4bfe-8c27-3d6ac7c72453", "name": "network-vif-plugged", "status": "completed", "tag": "72e623a1-47a8-4ba4-ae5c-a1c4eb8869fc"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:20:22.058652 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-7d0257b4-824c-47c9-a2df-ce24db0dab8e req-8dd9e373-8520-4a79-b9b8-118d4f97ad50 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:22.059125 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-7d0257b4-824c-47c9-a2df-ce24db0dab8e req-8dd9e373-8520-4a79-b9b8-118d4f97ad50 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:22.070603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-7d0257b4-824c-47c9-a2df-ce24db0dab8e req-8dd9e373-8520-4a79-b9b8-118d4f97ad50 service nova] Creating event network-vif-plugged:72e623a1-47a8-4ba4-ae5c-a1c4eb8869fc for instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 on hv-cinder-74216 Jul 04 04:20:22.076496 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-7d0257b4-824c-47c9-a2df-ce24db0dab8e req-8dd9e373-8520-4a79-b9b8-118d4f97ad50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031389 Jul 04 04:20:22.077221 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 315/645] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:20:22.186354 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-bd153302-4648-49e2-a860-74df95b0870b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:22.187212 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-bd153302-4648-49e2-a860-74df95b0870b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:22.193695 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bd153302-4648-49e2-a860-74df95b0870b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:22.194143 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bd153302-4648-49e2-a860-74df95b0870b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:22.194943 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bd153302-4648-49e2-a860-74df95b0870b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:22.195376 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bd153302-4648-49e2-a860-74df95b0870b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:22.341400 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-bd153302-4648-49e2-a860-74df95b0870b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:22.349536 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-bd153302-4648-49e2-a860-74df95b0870b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1728 microversion: 2.1 time: 0.167431 Jul 04 04:20:22.350090 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 331/646] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:22 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:22.367164 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c23f2dc8-013b-4b51-8885-4bb534e28c24 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:22.367745 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c23f2dc8-013b-4b51-8885-4bb534e28c24 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:22.374738 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c23f2dc8-013b-4b51-8885-4bb534e28c24 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:22.375219 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c23f2dc8-013b-4b51-8885-4bb534e28c24 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:22.375957 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c23f2dc8-013b-4b51-8885-4bb534e28c24 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:22.376396 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c23f2dc8-013b-4b51-8885-4bb534e28c24 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:22.469748 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c23f2dc8-013b-4b51-8885-4bb534e28c24 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106421 Jul 04 04:20:22.470599 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 316/647] 10.222.0.16 () {58 vars in 1274 bytes} [Mon Jul 4 04:20:22 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:20:22.894319 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-faf8ed3f-01bd-4222-8c40-a5c8d0bdf182 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:22.894971 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-faf8ed3f-01bd-4222-8c40-a5c8d0bdf182 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:22.901602 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-faf8ed3f-01bd-4222-8c40-a5c8d0bdf182 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:22.902045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-faf8ed3f-01bd-4222-8c40-a5c8d0bdf182 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:22.902952 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-faf8ed3f-01bd-4222-8c40-a5c8d0bdf182 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:22.903358 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-faf8ed3f-01bd-4222-8c40-a5c8d0bdf182 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:23.034352 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-faf8ed3f-01bd-4222-8c40-a5c8d0bdf182 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:23.043812 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-faf8ed3f-01bd-4222-8c40-a5c8d0bdf182 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:23.045298 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-faf8ed3f-01bd-4222-8c40-a5c8d0bdf182 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:23.046493 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-faf8ed3f-01bd-4222-8c40-a5c8d0bdf182 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.156180 Jul 04 04:20:23.047061 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 332/648] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:22 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:23.859229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-9c5707a1-8ec8-43d5-aca5-cea211032cbc req-2d54ccba-9feb-44c9-b9ce-753f3fedf8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfaa8d9e-b400-45d9-a635-3916ec760c32", "tag": "e37866cf-542d-489f-93a0-a1d504eaec14"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:20:23.867215 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-9c5707a1-8ec8-43d5-aca5-cea211032cbc req-2d54ccba-9feb-44c9-b9ce-753f3fedf8f8 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:23.867655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-9c5707a1-8ec8-43d5-aca5-cea211032cbc req-2d54ccba-9feb-44c9-b9ce-753f3fedf8f8 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:23.878595 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-9c5707a1-8ec8-43d5-aca5-cea211032cbc req-2d54ccba-9feb-44c9-b9ce-753f3fedf8f8 service nova] Creating event network-changed:e37866cf-542d-489f-93a0-a1d504eaec14 for instance cfaa8d9e-b400-45d9-a635-3916ec760c32 on hv-cinder-74216 Jul 04 04:20:23.883525 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-9c5707a1-8ec8-43d5-aca5-cea211032cbc req-2d54ccba-9feb-44c9-b9ce-753f3fedf8f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090831 Jul 04 04:20:23.884623 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 317/649] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:20:24.065286 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e4ab0da6-fb41-49ea-9e13-8a5cfbaa1f67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:24.065907 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e4ab0da6-fb41-49ea-9e13-8a5cfbaa1f67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:24.072961 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4ab0da6-fb41-49ea-9e13-8a5cfbaa1f67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:24.073390 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4ab0da6-fb41-49ea-9e13-8a5cfbaa1f67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:24.074171 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4ab0da6-fb41-49ea-9e13-8a5cfbaa1f67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:24.074680 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4ab0da6-fb41-49ea-9e13-8a5cfbaa1f67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:24.212844 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e4ab0da6-fb41-49ea-9e13-8a5cfbaa1f67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:24.221776 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e4ab0da6-fb41-49ea-9e13-8a5cfbaa1f67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:24.223692 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e4ab0da6-fb41-49ea-9e13-8a5cfbaa1f67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:24.224928 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e4ab0da6-fb41-49ea-9e13-8a5cfbaa1f67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.163623 Jul 04 04:20:24.225555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 333/650] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:24 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:25.244451 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-25a43337-9e01-48dd-adbc-d9c25d022a01 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:25.245215 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-25a43337-9e01-48dd-adbc-d9c25d022a01 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:25.252874 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-25a43337-9e01-48dd-adbc-d9c25d022a01 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:25.253324 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-25a43337-9e01-48dd-adbc-d9c25d022a01 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:25.254222 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-25a43337-9e01-48dd-adbc-d9c25d022a01 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:25.254787 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-25a43337-9e01-48dd-adbc-d9c25d022a01 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:25.396844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-25a43337-9e01-48dd-adbc-d9c25d022a01 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:25.406693 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-25a43337-9e01-48dd-adbc-d9c25d022a01 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:25.408149 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-25a43337-9e01-48dd-adbc-d9c25d022a01 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:25.409301 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-25a43337-9e01-48dd-adbc-d9c25d022a01 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1807 microversion: 2.20 time: 0.170401 Jul 04 04:20:25.409889 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 318/651] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:25 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:25.903036 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-1f16fd6f-82e6-418c-9744-569560fec332 req-553704b4-bbab-467f-af13-ea39bb720897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfaa8d9e-b400-45d9-a635-3916ec760c32", "tag": "e37866cf-542d-489f-93a0-a1d504eaec14"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:20:25.912183 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-1f16fd6f-82e6-418c-9744-569560fec332 req-553704b4-bbab-467f-af13-ea39bb720897 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:25.912615 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-1f16fd6f-82e6-418c-9744-569560fec332 req-553704b4-bbab-467f-af13-ea39bb720897 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:25.923856 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-1f16fd6f-82e6-418c-9744-569560fec332 req-553704b4-bbab-467f-af13-ea39bb720897 service nova] Creating event network-changed:e37866cf-542d-489f-93a0-a1d504eaec14 for instance cfaa8d9e-b400-45d9-a635-3916ec760c32 on hv-cinder-74216 Jul 04 04:20:25.928832 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-1f16fd6f-82e6-418c-9744-569560fec332 req-553704b4-bbab-467f-af13-ea39bb720897 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030751 Jul 04 04:20:25.929408 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 334/652] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:20:26.428347 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6e10ccc4-4e65-4c86-a6ae-1e9103a85a09 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:26.428955 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6e10ccc4-4e65-4c86-a6ae-1e9103a85a09 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:26.435931 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e10ccc4-4e65-4c86-a6ae-1e9103a85a09 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:26.436378 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e10ccc4-4e65-4c86-a6ae-1e9103a85a09 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:26.437139 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e10ccc4-4e65-4c86-a6ae-1e9103a85a09 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:26.437574 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e10ccc4-4e65-4c86-a6ae-1e9103a85a09 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:26.608791 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6e10ccc4-4e65-4c86-a6ae-1e9103a85a09 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:26.617547 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6e10ccc4-4e65-4c86-a6ae-1e9103a85a09 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:26.619160 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6e10ccc4-4e65-4c86-a6ae-1e9103a85a09 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:26.620315 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6e10ccc4-4e65-4c86-a6ae-1e9103a85a09 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1794 microversion: 2.20 time: 0.196347 Jul 04 04:20:26.620885 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 319/653] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:20:26 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1794 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:20:37.192086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=27 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:37.192997 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:37.258196 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3df94310-3c9d-4318-b507-38e26a7e88eb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:37.258805 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-3df94310-3c9d-4318-b507-38e26a7e88eb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:37.265782 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3df94310-3c9d-4318-b507-38e26a7e88eb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:37.266223 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3df94310-3c9d-4318-b507-38e26a7e88eb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:37.267080 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3df94310-3c9d-4318-b507-38e26a7e88eb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:37.267512 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3df94310-3c9d-4318-b507-38e26a7e88eb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:37.291900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3df94310-3c9d-4318-b507-38e26a7e88eb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3/ips" status: 200 len: 150 microversion: 2.1 time: 0.103035 Jul 04 04:20:37.292443 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 335/654] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jul 4 04:20:37 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3/ips => generated 150 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:20:37.303469 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-373ec10f-e57e-48a1-875c-3981d5188828 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e5a697f-11b5-496c-84ab-99ad2f03a698"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:20:37.304536 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-373ec10f-e57e-48a1-875c-3981d5188828 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:37.306949 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=31 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:37.307629 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=74 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:37.313803 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-373ec10f-e57e-48a1-875c-3981d5188828 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:37.314254 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-373ec10f-e57e-48a1-875c-3981d5188828 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:37.315058 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-373ec10f-e57e-48a1-875c-3981d5188828 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:37.315501 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-373ec10f-e57e-48a1-875c-3981d5188828 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:37.403265 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-373ec10f-e57e-48a1-875c-3981d5188828 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] HTTP exception thrown: Invalid volume: volume 9e5a697f-11b5-496c-84ab-99ad2f03a698 is already attached to instances: be90f3f9-d0dd-4296-ba6b-dc719d491a12 Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-373ec10f-e57e-48a1-875c-3981d5188828 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Request method failure captured: Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: POST /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3/os-volume_attachments HTTP/1.1 Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 74 Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmkvvNXviK4RHs-pC2ZUGxhjzRMF8G1iwt3QQvENmXB_WKs6Un0uo-bkU60UeA5mbFaWI8DULlMS96BRMKHcqOYLorEFYdRp34ZJFtZG4dJDmi0fE-jBVj7rCHrbsjhLZ51yhgpFUDC-ASYnpBPbmkcyUWrK8JyNvv4uGci2lLUQkr4 Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:20:37.406541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:20:37.408167 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ccd298eebe6413daaae0d801e902616", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:20:37.408167 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:20:37.408167 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:20:37.408167 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:20:37.408167 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:20:37.408167 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:20:37.408167 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:20:37.408167 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: 4041faa2919d4760ae10907070a10dc7 Jul 04 04:20:37.408167 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:20:37.408167 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Jul 04 04:20:37.408167 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {"volumeAttachment": {"volumeId": "9e5a697f-11b5-496c-84ab-99ad2f03a698"}} Jul 04 04:20:37.408167 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:20:37.409025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Invalid volume: volume 9e5a697f-11b5-496c-84ab-99ad2f03a698 is already attached to instances: be90f3f9-d0dd-4296-ba6b-dc719d491a12 Jul 04 04:20:37.409025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'server_id': 'c03c5904-d825-409f-a638-bb9ce914aec3', 'body': {'volumeAttachment': {'volumeId': '9e5a697f-11b5-496c-84ab-99ad2f03a698'}}} Jul 04 04:20:37.409025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:20:37.409025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:20:37.409025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 04 04:20:37.409025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 04 04:20:37.409025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 04:20:37.409025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 04:20:37.409025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 04 04:20:37.409025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 04 04:20:37.409025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 04 04:20:37.409025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 04 04:20:37.409025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 04 04:20:37.409025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 04 04:20:37.409025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9e5a697f-11b5-496c-84ab-99ad2f03a698 is already attached to instances: be90f3f9-d0dd-4296-ba6b-dc719d491a12 Jul 04 04:20:37.409025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:20:37.409025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:20:37.409025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:20:37.409025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9e5a697f-11b5-496c-84ab-99ad2f03a698 is already attached to instances: be90f3f9-d0dd-4296-ba6b-dc719d491a12 Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:20:37.410293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:20:37.411495 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:20:37.411495 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:20:37.411495 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:20:37.411495 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9e5a697f-11b5-496c-84ab-99ad2f03a698 is already attached to instances: be90f3f9-d0dd-4296-ba6b-dc719d491a12 Jul 04 04:20:37.411495 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:20:37.411495 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-373ec10f-e57e-48a1-875c-3981d5188828 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Returning 400 to user: Invalid volume: volume 9e5a697f-11b5-496c-84ab-99ad2f03a698 is already attached to instances: be90f3f9-d0dd-4296-ba6b-dc719d491a12 {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:20:37.411495 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-373ec10f-e57e-48a1-875c-3981d5188828 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "POST /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108615 Jul 04 04:20:37.411495 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 320/655] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jul 4 04:20:37 2022] POST /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 04:20:37.417108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-fc037ff7-0b28-4d78-9271-f39f54a36baf tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:37.417563 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-fc037ff7-0b28-4d78-9271-f39f54a36baf tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:37.423996 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fc037ff7-0b28-4d78-9271-f39f54a36baf tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:37.424435 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fc037ff7-0b28-4d78-9271-f39f54a36baf tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:37.425218 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fc037ff7-0b28-4d78-9271-f39f54a36baf tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:37.425644 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fc037ff7-0b28-4d78-9271-f39f54a36baf tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:37.450053 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-fc037ff7-0b28-4d78-9271-f39f54a36baf tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Going to try to terminate instance {{(pid=117875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:20:37.533950 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-fc037ff7-0b28-4d78-9271-f39f54a36baf tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 204 len: 0 microversion: 2.1 time: 0.120219 Jul 04 04:20:37.535143 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 336/656] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:20:37 2022] DELETE /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:20:37.545074 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0fc4b8f1-1c5f-4e8f-a076-e8e247838ad9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:37.546063 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0fc4b8f1-1c5f-4e8f-a076-e8e247838ad9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:37.555541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fc4b8f1-1c5f-4e8f-a076-e8e247838ad9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:37.555995 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fc4b8f1-1c5f-4e8f-a076-e8e247838ad9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:37.556767 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fc4b8f1-1c5f-4e8f-a076-e8e247838ad9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:37.557203 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0fc4b8f1-1c5f-4e8f-a076-e8e247838ad9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:37.700591 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0fc4b8f1-1c5f-4e8f-a076-e8e247838ad9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:37.710872 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0fc4b8f1-1c5f-4e8f-a076-e8e247838ad9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 200 len: 1683 microversion: 2.1 time: 0.170779 Jul 04 04:20:37.711548 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 321/657] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:37 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:38.734590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-426056fa-fec1-4b4c-aa6e-6c0762759aff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:38.735462 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-426056fa-fec1-4b4c-aa6e-6c0762759aff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:38.745004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-426056fa-fec1-4b4c-aa6e-6c0762759aff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:38.745607 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-426056fa-fec1-4b4c-aa6e-6c0762759aff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:38.746953 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-426056fa-fec1-4b4c-aa6e-6c0762759aff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:38.747472 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-426056fa-fec1-4b4c-aa6e-6c0762759aff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:38.896407 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-426056fa-fec1-4b4c-aa6e-6c0762759aff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:38.904676 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-426056fa-fec1-4b4c-aa6e-6c0762759aff tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 200 len: 1683 microversion: 2.1 time: 0.177727 Jul 04 04:20:38.905395 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 337/658] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:38 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:20:38.956774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3ced42ef-da7f-47e2-b36e-08d640f5b2d6 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-642876144"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:20:38.957345 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3ced42ef-da7f-47e2-b36e-08d640f5b2d6 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:38.964250 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ced42ef-da7f-47e2-b36e-08d640f5b2d6 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:38.964695 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ced42ef-da7f-47e2-b36e-08d640f5b2d6 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:38.965460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ced42ef-da7f-47e2-b36e-08d640f5b2d6 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:38.965892 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ced42ef-da7f-47e2-b36e-08d640f5b2d6 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:39.097471 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.network.security_group_api [None req-3ced42ef-da7f-47e2-b36e-08d640f5b2d6 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Removing security group cbd67096-6283-4aaf-9ea3-be44bec82ce8 from port 824e9a73-e83d-443e-a6cb-c8627c01096f Jul 04 04:20:39.465169 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3ced42ef-da7f-47e2-b36e-08d640f5b2d6 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "POST /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886/action" status: 202 len: 0 microversion: 2.1 time: 0.512353 Jul 04 04:20:39.471506 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 322/659] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 4 04:20:38 2022] POST /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:20:39.475105 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-a6d2a986-f769-44ca-b955-62d8e8596925 req-c240bc14-3e8b-4f8d-a557-6a46385fbef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb07e282-565d-4780-b4e0-9fcc76ac5886", "tag": "824e9a73-e83d-443e-a6cb-c8627c01096f"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:20:39.494693 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-a6d2a986-f769-44ca-b955-62d8e8596925 req-c240bc14-3e8b-4f8d-a557-6a46385fbef3 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:39.495102 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-a6d2a986-f769-44ca-b955-62d8e8596925 req-c240bc14-3e8b-4f8d-a557-6a46385fbef3 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:39.511746 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-a6d2a986-f769-44ca-b955-62d8e8596925 req-c240bc14-3e8b-4f8d-a557-6a46385fbef3 service nova] Creating event network-changed:824e9a73-e83d-443e-a6cb-c8627c01096f for instance fb07e282-565d-4780-b4e0-9fcc76ac5886 on hv-cinder-74216 Jul 04 04:20:39.526160 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-a6d2a986-f769-44ca-b955-62d8e8596925 req-c240bc14-3e8b-4f8d-a557-6a46385fbef3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054573 Jul 04 04:20:39.535351 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 338/660] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:20:39.929418 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-046df72c-caa9-411d-92e2-5f0be5726039 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:39.930298 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-046df72c-caa9-411d-92e2-5f0be5726039 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:39.937924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-046df72c-caa9-411d-92e2-5f0be5726039 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:39.938895 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-046df72c-caa9-411d-92e2-5f0be5726039 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:39.939897 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-046df72c-caa9-411d-92e2-5f0be5726039 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:39.940518 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-046df72c-caa9-411d-92e2-5f0be5726039 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:40.161177 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-046df72c-caa9-411d-92e2-5f0be5726039 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:40.169911 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-046df72c-caa9-411d-92e2-5f0be5726039 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 200 len: 1683 microversion: 2.1 time: 0.245581 Jul 04 04:20:40.171143 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 323/661] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:39 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 1683 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:41.191301 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-2e3bbcab-01e3-4e24-b165-fa2b149e2840 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:41.192109 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-2e3bbcab-01e3-4e24-b165-fa2b149e2840 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:41.198586 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2e3bbcab-01e3-4e24-b165-fa2b149e2840 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:41.199096 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2e3bbcab-01e3-4e24-b165-fa2b149e2840 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:41.199921 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2e3bbcab-01e3-4e24-b165-fa2b149e2840 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:41.200567 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2e3bbcab-01e3-4e24-b165-fa2b149e2840 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:41.301532 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-2e3bbcab-01e3-4e24-b165-fa2b149e2840 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:41.309570 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-2e3bbcab-01e3-4e24-b165-fa2b149e2840 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 200 len: 1615 microversion: 2.1 time: 0.124533 Jul 04 04:20:41.310221 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 339/662] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:41 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 1615 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:41.670714 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-0a49bc7d-3fb3-4cfe-acd1-68b0486cd339 req-478ea06a-ee71-451a-b534-2e398eec3ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c03c5904-d825-409f-a638-bb9ce914aec3", "name": "network-vif-deleted", "tag": "b9b0e8c3-8c3b-483a-9a1a-c95a4d7fe2da"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:20:41.697235 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-0a49bc7d-3fb3-4cfe-acd1-68b0486cd339 req-478ea06a-ee71-451a-b534-2e398eec3ad8 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:41.698022 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-0a49bc7d-3fb3-4cfe-acd1-68b0486cd339 req-478ea06a-ee71-451a-b534-2e398eec3ad8 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:41.722526 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-bdc48981-fe1b-42b9-b918-590602fff3b5 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:41.723032 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-bdc48981-fe1b-42b9-b918-590602fff3b5 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:41.723670 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-0a49bc7d-3fb3-4cfe-acd1-68b0486cd339 req-478ea06a-ee71-451a-b534-2e398eec3ad8 service nova] Creating event network-vif-deleted:b9b0e8c3-8c3b-483a-9a1a-c95a4d7fe2da for instance c03c5904-d825-409f-a638-bb9ce914aec3 on hv-cinder-74216 Jul 04 04:20:41.730128 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bdc48981-fe1b-42b9-b918-590602fff3b5 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:41.730566 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-0a49bc7d-3fb3-4cfe-acd1-68b0486cd339 req-478ea06a-ee71-451a-b534-2e398eec3ad8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150772 Jul 04 04:20:41.730714 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bdc48981-fe1b-42b9-b918-590602fff3b5 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:41.731418 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bdc48981-fe1b-42b9-b918-590602fff3b5 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:41.731991 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bdc48981-fe1b-42b9-b918-590602fff3b5 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:41.732219 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 324/663] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:20:41.911902 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.objects.instance [None req-bdc48981-fe1b-42b9-b918-590602fff3b5 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lazy-loading 'services' on Instance uuid fb07e282-565d-4780-b4e0-9fcc76ac5886 {{(pid=117875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:20:42.053222 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-bdc48981-fe1b-42b9-b918-590602fff3b5 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886/os-volume_attachments/82a461f2-51fb-46e2-8cc5-91a86b7cc237" status: 202 len: 0 microversion: 2.1 time: 0.334506 Jul 04 04:20:42.057128 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 340/664] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jul 4 04:20:41 2022] DELETE /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886/os-volume_attachments/82a461f2-51fb-46e2-8cc5-91a86b7cc237 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 04:20:42.063476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-de7d4407-bc30-4f2a-9a86-9643ae7be696 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:42.064793 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-de7d4407-bc30-4f2a-9a86-9643ae7be696 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:42.072465 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de7d4407-bc30-4f2a-9a86-9643ae7be696 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:42.073183 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de7d4407-bc30-4f2a-9a86-9643ae7be696 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:42.074005 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de7d4407-bc30-4f2a-9a86-9643ae7be696 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:42.074628 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de7d4407-bc30-4f2a-9a86-9643ae7be696 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:42.142854 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-de7d4407-bc30-4f2a-9a86-9643ae7be696 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083693 Jul 04 04:20:42.143917 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 325/665] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:20:42 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:20:42.330402 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1f4d8239-2c3a-4cb7-8e71-db138207fd3f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:42.335700 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-1f4d8239-2c3a-4cb7-8e71-db138207fd3f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:42.346993 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1f4d8239-2c3a-4cb7-8e71-db138207fd3f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:42.348008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1f4d8239-2c3a-4cb7-8e71-db138207fd3f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:42.348975 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1f4d8239-2c3a-4cb7-8e71-db138207fd3f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:42.349608 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1f4d8239-2c3a-4cb7-8e71-db138207fd3f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:42.373537 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-1f4d8239-2c3a-4cb7-8e71-db138207fd3f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] HTTP exception thrown: Instance c03c5904-d825-409f-a638-bb9ce914aec3 could not be found. Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1f4d8239-2c3a-4cb7-8e71-db138207fd3f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Request method failure captured: Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 HTTP/1.1 Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmkvvNXviK4RHs-pC2ZUGxhjzRMF8G1iwt3QQvENmXB_WKs6Un0uo-bkU60UeA5mbFaWI8DULlMS96BRMKHcqOYLorEFYdRp34ZJFtZG4dJDmi0fE-jBVj7rCHrbsjhLZ51yhgpFUDC-ASYnpBPbmkcyUWrK8JyNvv4uGci2lLUQkr4 Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:20:42.376072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:20:42.377492 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ccd298eebe6413daaae0d801e902616", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:20:42.377492 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:20:42.377492 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:20:42.377492 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:20:42.377492 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:20:42.377492 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:20:42.377492 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:20:42.377492 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 4041faa2919d4760ae10907070a10dc7 Jul 04 04:20:42.377492 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:20:42.377492 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:20:42.377492 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance c03c5904-d825-409f-a638-bb9ce914aec3 could not be found. Jul 04 04:20:42.377492 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': 'c03c5904-d825-409f-a638-bb9ce914aec3'} Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c03c5904-d825-409f-a638-bb9ce914aec3 could not be found. Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:20:42.378345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:20:42.380005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:20:42.380005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:20:42.380005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:20:42.380005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:20:42.380005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:20:42.380005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:20:42.380005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:20:42.380005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c03c5904-d825-409f-a638-bb9ce914aec3 could not be found. Jul 04 04:20:42.380005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:20:42.380005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:20:42.380005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:20:42.380005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:20:42.380005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:20:42.380005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:20:42.380005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:20:42.380005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:20:42.380005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c03c5904-d825-409f-a638-bb9ce914aec3 could not be found. Jul 04 04:20:42.380005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:20:42.382388 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1f4d8239-2c3a-4cb7-8e71-db138207fd3f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Returning 404 to user: Instance c03c5904-d825-409f-a638-bb9ce914aec3 could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:20:42.383521 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-1f4d8239-2c3a-4cb7-8e71-db138207fd3f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 404 len: 111 microversion: 2.1 time: 0.059754 Jul 04 04:20:42.384383 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 341/666] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:42 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:20:42.397298 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5f560963-8b8f-402c-9787-8ab849a3530d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '.version_select at 0x7f50c1065a60>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:42.426799 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5f560963-8b8f-402c-9787-8ab849a3530d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1402810921" status: 202 len: 0 microversion: 2.1 time: 0.036190 Jul 04 04:20:42.432067 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 326/667] 10.222.0.16 () {58 vars in 1220 bytes} [Mon Jul 4 04:20:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1402810921 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:20:43.159043 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ae47a13c-6c43-4b3a-9732-d8b3aeeb52e3 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:43.160309 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-ae47a13c-6c43-4b3a-9732-d8b3aeeb52e3 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:43.172479 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ae47a13c-6c43-4b3a-9732-d8b3aeeb52e3 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:43.173191 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ae47a13c-6c43-4b3a-9732-d8b3aeeb52e3 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:43.174139 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ae47a13c-6c43-4b3a-9732-d8b3aeeb52e3 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:43.174794 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ae47a13c-6c43-4b3a-9732-d8b3aeeb52e3 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:43.216250 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ae47a13c-6c43-4b3a-9732-d8b3aeeb52e3 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065452 Jul 04 04:20:43.218409 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 342/668] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:20:43 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:20:43.747907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-5b5b5065-bac8-4cbb-b13f-f8c1dd3ebc1c req-d151bdef-ba64-4a29-af42-b8dd18cee05f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb07e282-565d-4780-b4e0-9fcc76ac5886", "tag": "824e9a73-e83d-443e-a6cb-c8627c01096f"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:20:43.760044 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-5b5b5065-bac8-4cbb-b13f-f8c1dd3ebc1c req-d151bdef-ba64-4a29-af42-b8dd18cee05f service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:43.760576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-5b5b5065-bac8-4cbb-b13f-f8c1dd3ebc1c req-d151bdef-ba64-4a29-af42-b8dd18cee05f service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:43.774074 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-5b5b5065-bac8-4cbb-b13f-f8c1dd3ebc1c req-d151bdef-ba64-4a29-af42-b8dd18cee05f service nova] Creating event network-changed:824e9a73-e83d-443e-a6cb-c8627c01096f for instance fb07e282-565d-4780-b4e0-9fcc76ac5886 on hv-cinder-74216 Jul 04 04:20:43.783426 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-5b5b5065-bac8-4cbb-b13f-f8c1dd3ebc1c req-d151bdef-ba64-4a29-af42-b8dd18cee05f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039947 Jul 04 04:20:43.785648 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-80c39bec-2d68-47ea-926c-38f61478d0d2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:43.786165 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-80c39bec-2d68-47ea-926c-38f61478d0d2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:43.787148 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 327/669] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:20:43.793383 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-80c39bec-2d68-47ea-926c-38f61478d0d2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:43.793833 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-80c39bec-2d68-47ea-926c-38f61478d0d2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:43.794645 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-80c39bec-2d68-47ea-926c-38f61478d0d2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:43.795130 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-80c39bec-2d68-47ea-926c-38f61478d0d2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:43.877307 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.objects.instance [None req-80c39bec-2d68-47ea-926c-38f61478d0d2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lazy-loading 'services' on Instance uuid be90f3f9-d0dd-4296-ba6b-dc719d491a12 {{(pid=117875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:20:43.965279 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-80c39bec-2d68-47ea-926c-38f61478d0d2 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "DELETE /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12/os-volume_attachments/9e5a697f-11b5-496c-84ab-99ad2f03a698" status: 202 len: 0 microversion: 2.1 time: 0.184188 Jul 04 04:20:43.965783 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 343/670] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jul 4 04:20:43 2022] DELETE /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12/os-volume_attachments/9e5a697f-11b5-496c-84ab-99ad2f03a698 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:20:43.976059 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-033b4712-41f2-4e46-bc6f-58d55f83c9fe tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:43.981642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-033b4712-41f2-4e46-bc6f-58d55f83c9fe tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:43.992138 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-033b4712-41f2-4e46-bc6f-58d55f83c9fe tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:43.992586 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-033b4712-41f2-4e46-bc6f-58d55f83c9fe tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:43.993357 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-033b4712-41f2-4e46-bc6f-58d55f83c9fe tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:43.994110 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-033b4712-41f2-4e46-bc6f-58d55f83c9fe tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:44.033784 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-033b4712-41f2-4e46-bc6f-58d55f83c9fe tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061877 Jul 04 04:20:44.035329 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 328/671] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:20:43 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:20:44.228683 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ffc11279-92ad-43d2-b72f-6270bc6b11b2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:44.229684 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-ffc11279-92ad-43d2-b72f-6270bc6b11b2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:44.236196 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ffc11279-92ad-43d2-b72f-6270bc6b11b2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:44.236634 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ffc11279-92ad-43d2-b72f-6270bc6b11b2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:44.237383 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ffc11279-92ad-43d2-b72f-6270bc6b11b2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:44.237808 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ffc11279-92ad-43d2-b72f-6270bc6b11b2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:44.266724 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ffc11279-92ad-43d2-b72f-6270bc6b11b2 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042787 Jul 04 04:20:44.267281 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 344/672] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:20:44 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 04:20:44.277293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-43fada7d-789b-4652-87a5-59e1d5ffc41f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:44.277814 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-43fada7d-789b-4652-87a5-59e1d5ffc41f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:44.284162 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43fada7d-789b-4652-87a5-59e1d5ffc41f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:44.284606 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43fada7d-789b-4652-87a5-59e1d5ffc41f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:44.285360 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43fada7d-789b-4652-87a5-59e1d5ffc41f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:44.285788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43fada7d-789b-4652-87a5-59e1d5ffc41f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:44.362364 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-43fada7d-789b-4652-87a5-59e1d5ffc41f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] HTTP exception thrown: Instance fb07e282-565d-4780-b4e0-9fcc76ac5886 is not attached to volume 82a461f2-51fb-46e2-8cc5-91a86b7cc237 Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-43fada7d-789b-4652-87a5-59e1d5ffc41f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Request method failure captured: Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886/os-volume_attachments/82a461f2-51fb-46e2-8cc5-91a86b7cc237 HTTP/1.1 Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmmBg8Nzi_-TnqjZ0XWNEuUrqbb5ZmuGP1CpHMpwof__8Epj-ewx1YK1FhX4l9W1cF_f3qioGP011qt8ztprQLQAGrZsNGYusPmBNaQsl9NQ4raZPH3aCnS1mwjnaKBFBgjxcRllCP5ak8rP1BoUbs7vx_ej9dTkls57WiAcXZ0hA1c Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: c487ee37e54042d680eccb72b046bb55 Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-TestMinimumBasicScenario-416866987 Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:20:44.364844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:20:44.366403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c487ee37e54042d680eccb72b046bb55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c487ee37e54042d680eccb72b046bb55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c487ee37e54042d680eccb72b046bb55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c487ee37e54042d680eccb72b046bb55", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:20:44.366403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-TestMinimumBasicScenario-416866987 Jul 04 04:20:44.366403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: c487ee37e54042d680eccb72b046bb55 Jul 04 04:20:44.366403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-TestMinimumBasicScenario-416866987 Jul 04 04:20:44.366403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-TestMinimumBasicScenario-416866987-project Jul 04 04:20:44.366403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:20:44.366403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:20:44.366403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: 031fb205335f407bb2d275476b98fe24 Jul 04 04:20:44.366403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-TestMinimumBasicScenario-416866987-project Jul 04 04:20:44.366403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:20:44.366403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance fb07e282-565d-4780-b4e0-9fcc76ac5886 is not attached to volume 82a461f2-51fb-46e2-8cc5-91a86b7cc237 Jul 04 04:20:44.369880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'server_id': 'fb07e282-565d-4780-b4e0-9fcc76ac5886', 'id': '82a461f2-51fb-46e2-8cc5-91a86b7cc237'} Jul 04 04:20:44.369880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:20:44.369880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:20:44.369880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 04 04:20:44.369880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 04 04:20:44.369880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 04:20:44.369880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 04:20:44.369880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 04 04:20:44.369880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 04 04:20:44.369880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 82a461f2-51fb-46e2-8cc5-91a86b7cc237. Jul 04 04:20:44.369880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:20:44.369880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:20:44.369880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:20:44.369880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:20:44.369880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:20:44.369880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:20:44.369880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:20:44.369880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:20:44.369880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:20:44.371391 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:20:44.371391 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 04 04:20:44.371391 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 04 04:20:44.371391 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb07e282-565d-4780-b4e0-9fcc76ac5886 is not attached to volume 82a461f2-51fb-46e2-8cc5-91a86b7cc237 Jul 04 04:20:44.371391 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:20:44.371391 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:20:44.371391 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:20:44.371391 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:20:44.371391 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:20:44.371391 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:20:44.371391 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:20:44.371391 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:20:44.371391 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb07e282-565d-4780-b4e0-9fcc76ac5886 is not attached to volume 82a461f2-51fb-46e2-8cc5-91a86b7cc237 Jul 04 04:20:44.371391 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:20:44.371391 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-43fada7d-789b-4652-87a5-59e1d5ffc41f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Returning 404 to user: Instance fb07e282-565d-4780-b4e0-9fcc76ac5886 is not attached to volume 82a461f2-51fb-46e2-8cc5-91a86b7cc237 {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:20:44.372499 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-43fada7d-789b-4652-87a5-59e1d5ffc41f tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886/os-volume_attachments/82a461f2-51fb-46e2-8cc5-91a86b7cc237" status: 404 len: 154 microversion: 2.1 time: 0.093003 Jul 04 04:20:44.372499 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 329/673] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jul 4 04:20:44 2022] DELETE /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886/os-volume_attachments/82a461f2-51fb-46e2-8cc5-91a86b7cc237 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:20:45.045826 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-6de699bd-ce83-4cdb-9c39-b057c93c14fc tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:45.046787 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-6de699bd-ce83-4cdb-9c39-b057c93c14fc tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:45.053687 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6de699bd-ce83-4cdb-9c39-b057c93c14fc tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:45.054191 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6de699bd-ce83-4cdb-9c39-b057c93c14fc tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:45.055357 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6de699bd-ce83-4cdb-9c39-b057c93c14fc tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:45.055962 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6de699bd-ce83-4cdb-9c39-b057c93c14fc tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:45.085880 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-6de699bd-ce83-4cdb-9c39-b057c93c14fc tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044089 Jul 04 04:20:45.086469 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 345/674] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:20:45 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:20:45.530217 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fb9f1316-e2c2-454f-a852-bd532424e199 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:45.530785 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fb9f1316-e2c2-454f-a852-bd532424e199 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:45.537644 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb9f1316-e2c2-454f-a852-bd532424e199 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:45.538089 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb9f1316-e2c2-454f-a852-bd532424e199 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:45.538886 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb9f1316-e2c2-454f-a852-bd532424e199 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:45.539315 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb9f1316-e2c2-454f-a852-bd532424e199 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:45.564651 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fb9f1316-e2c2-454f-a852-bd532424e199 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:20:45.644914 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fb9f1316-e2c2-454f-a852-bd532424e199 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 204 len: 0 microversion: 2.1 time: 0.118324 Jul 04 04:20:45.645608 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 330/675] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:20:45 2022] DELETE /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:20:45.653905 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-fc0c3924-d903-470c-ae23-ba3573026027 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:45.654750 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-fc0c3924-d903-470c-ae23-ba3573026027 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:45.661161 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fc0c3924-d903-470c-ae23-ba3573026027 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:45.661587 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fc0c3924-d903-470c-ae23-ba3573026027 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:45.662462 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fc0c3924-d903-470c-ae23-ba3573026027 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:45.662909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fc0c3924-d903-470c-ae23-ba3573026027 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:45.805497 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-fc0c3924-d903-470c-ae23-ba3573026027 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:45.814800 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-fc0c3924-d903-470c-ae23-ba3573026027 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1550 microversion: 2.1 time: 0.164833 Jul 04 04:20:45.815499 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 346/676] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:45 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1550 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:46.103051 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b6a8ccaa-36ce-4b89-8588-e5fba7f67342 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:46.104499 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b6a8ccaa-36ce-4b89-8588-e5fba7f67342 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:46.112034 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6a8ccaa-36ce-4b89-8588-e5fba7f67342 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:46.112486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6a8ccaa-36ce-4b89-8588-e5fba7f67342 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:46.113242 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6a8ccaa-36ce-4b89-8588-e5fba7f67342 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:46.113675 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6a8ccaa-36ce-4b89-8588-e5fba7f67342 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:46.144309 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b6a8ccaa-36ce-4b89-8588-e5fba7f67342 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048202 Jul 04 04:20:46.144869 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 331/677] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:20:46 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 04:20:46.211433 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c1200518-d5c2-4756-be31-c9f46c5691f7 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:46.211962 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c1200518-d5c2-4756-be31-c9f46c5691f7 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:46.222844 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c1200518-d5c2-4756-be31-c9f46c5691f7 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:46.223448 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c1200518-d5c2-4756-be31-c9f46c5691f7 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:46.224591 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c1200518-d5c2-4756-be31-c9f46c5691f7 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:46.225216 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c1200518-d5c2-4756-be31-c9f46c5691f7 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:46.253717 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c1200518-d5c2-4756-be31-c9f46c5691f7 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Going to try to terminate instance {{(pid=117875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:20:46.338354 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c1200518-d5c2-4756-be31-c9f46c5691f7 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "DELETE /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 204 len: 0 microversion: 2.1 time: 0.133031 Jul 04 04:20:46.338947 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 347/678] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:20:46 2022] DELETE /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:20:46.347282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5c44ea49-e694-40e6-9f4b-1350ac9e28be tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:46.347898 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5c44ea49-e694-40e6-9f4b-1350ac9e28be tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:46.353993 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c44ea49-e694-40e6-9f4b-1350ac9e28be tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:46.354457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c44ea49-e694-40e6-9f4b-1350ac9e28be tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:46.355161 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c44ea49-e694-40e6-9f4b-1350ac9e28be tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:46.355590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c44ea49-e694-40e6-9f4b-1350ac9e28be tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:46.497203 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5c44ea49-e694-40e6-9f4b-1350ac9e28be tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:46.505533 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5c44ea49-e694-40e6-9f4b-1350ac9e28be tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1680 microversion: 2.1 time: 0.162162 Jul 04 04:20:46.506117 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 332/679] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:46 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:46.837682 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7a2e1e2e-33b6-4c5f-b03b-70a97b97f6ea tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:46.838868 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7a2e1e2e-33b6-4c5f-b03b-70a97b97f6ea tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:46.849267 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7a2e1e2e-33b6-4c5f-b03b-70a97b97f6ea tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:46.850011 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7a2e1e2e-33b6-4c5f-b03b-70a97b97f6ea tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:46.851338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7a2e1e2e-33b6-4c5f-b03b-70a97b97f6ea tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:46.852055 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7a2e1e2e-33b6-4c5f-b03b-70a97b97f6ea tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:46.872989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:47.002311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7a2e1e2e-33b6-4c5f-b03b-70a97b97f6ea tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:47.010580 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7a2e1e2e-33b6-4c5f-b03b-70a97b97f6ea tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1550 microversion: 2.1 time: 0.179974 Jul 04 04:20:47.011189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 348/680] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:46 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1550 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:47.528279 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a93f3949-c9dc-4c1a-ad3a-658ea10b1357 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:47.528823 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a93f3949-c9dc-4c1a-ad3a-658ea10b1357 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:47.536097 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a93f3949-c9dc-4c1a-ad3a-658ea10b1357 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:47.536557 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a93f3949-c9dc-4c1a-ad3a-658ea10b1357 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:47.537338 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a93f3949-c9dc-4c1a-ad3a-658ea10b1357 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:47.537769 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a93f3949-c9dc-4c1a-ad3a-658ea10b1357 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:47.677083 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a93f3949-c9dc-4c1a-ad3a-658ea10b1357 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:47.685112 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a93f3949-c9dc-4c1a-ad3a-658ea10b1357 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1680 microversion: 2.1 time: 0.160893 Jul 04 04:20:47.685718 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 333/681] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:47 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:48.032182 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9f858324-3792-4188-8c1c-21328b8a0d4a tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:48.032783 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-9f858324-3792-4188-8c1c-21328b8a0d4a tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:48.040828 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9f858324-3792-4188-8c1c-21328b8a0d4a tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:48.041412 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9f858324-3792-4188-8c1c-21328b8a0d4a tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:48.042540 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9f858324-3792-4188-8c1c-21328b8a0d4a tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:48.043157 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9f858324-3792-4188-8c1c-21328b8a0d4a tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:48.187146 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9f858324-3792-4188-8c1c-21328b8a0d4a tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:48.195579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9f858324-3792-4188-8c1c-21328b8a0d4a tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1550 microversion: 2.1 time: 0.168211 Jul 04 04:20:48.197577 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 349/682] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:48 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1550 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:48.703380 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7c99b771-e9a6-4f97-9873-80bfd02229bd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:48.704093 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7c99b771-e9a6-4f97-9873-80bfd02229bd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:48.711072 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c99b771-e9a6-4f97-9873-80bfd02229bd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:48.711557 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c99b771-e9a6-4f97-9873-80bfd02229bd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:48.712325 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c99b771-e9a6-4f97-9873-80bfd02229bd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:48.712756 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7c99b771-e9a6-4f97-9873-80bfd02229bd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:48.949101 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7c99b771-e9a6-4f97-9873-80bfd02229bd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:48.957384 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7c99b771-e9a6-4f97-9873-80bfd02229bd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1680 microversion: 2.1 time: 0.258315 Jul 04 04:20:48.967156 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 334/683] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:48 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1680 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:49.080181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-0514de0b-9147-4664-8ddb-33f515257d47 req-e15b0c70-ed74-4de4-83ea-957b23d480fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb07e282-565d-4780-b4e0-9fcc76ac5886", "name": "network-vif-deleted", "tag": "824e9a73-e83d-443e-a6cb-c8627c01096f"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:20:49.089954 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-0514de0b-9147-4664-8ddb-33f515257d47 req-e15b0c70-ed74-4de4-83ea-957b23d480fb service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:49.090681 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-0514de0b-9147-4664-8ddb-33f515257d47 req-e15b0c70-ed74-4de4-83ea-957b23d480fb service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:49.102820 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-0514de0b-9147-4664-8ddb-33f515257d47 req-e15b0c70-ed74-4de4-83ea-957b23d480fb service nova] Creating event network-vif-deleted:824e9a73-e83d-443e-a6cb-c8627c01096f for instance fb07e282-565d-4780-b4e0-9fcc76ac5886 on hv-cinder-74216 Jul 04 04:20:49.108337 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-0514de0b-9147-4664-8ddb-33f515257d47 req-e15b0c70-ed74-4de4-83ea-957b23d480fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031678 Jul 04 04:20:49.108984 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 350/684] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:20:49.217176 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d1d16317-d59d-4115-b580-0fae5acbea18 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:49.217777 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d1d16317-d59d-4115-b580-0fae5acbea18 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:49.224029 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1d16317-d59d-4115-b580-0fae5acbea18 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:49.224477 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1d16317-d59d-4115-b580-0fae5acbea18 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:49.225877 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1d16317-d59d-4115-b580-0fae5acbea18 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:49.226317 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1d16317-d59d-4115-b580-0fae5acbea18 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:49.257640 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1d16317-d59d-4115-b580-0fae5acbea18 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:49.258083 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1d16317-d59d-4115-b580-0fae5acbea18 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:49.258564 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-d1d16317-d59d-4115-b580-0fae5acbea18 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lazy-loading 'fault' on Instance uuid fb07e282-565d-4780-b4e0-9fcc76ac5886 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:20:49.301470 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d1d16317-d59d-4115-b580-0fae5acbea18 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '031fb205335f407bb2d275476b98fe24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c487ee37e54042d680eccb72b046bb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:49.308994 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d1d16317-d59d-4115-b580-0fae5acbea18 tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 200 len: 1346 microversion: 2.1 time: 0.096010 Jul 04 04:20:49.309502 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 335/685] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:49 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 1346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:49.679339 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-5dde6408-15f9-485a-a241-f1fcbad0273b req-3ac818cc-ed56-4390-815a-9edab531f15b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be90f3f9-d0dd-4296-ba6b-dc719d491a12", "name": "network-vif-deleted", "tag": "9e8db02a-f437-48df-a498-4ab55ec549fb"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:20:49.688615 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-5dde6408-15f9-485a-a241-f1fcbad0273b req-3ac818cc-ed56-4390-815a-9edab531f15b service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:49.689200 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-5dde6408-15f9-485a-a241-f1fcbad0273b req-3ac818cc-ed56-4390-815a-9edab531f15b service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:49.700620 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-5dde6408-15f9-485a-a241-f1fcbad0273b req-3ac818cc-ed56-4390-815a-9edab531f15b service nova] Creating event network-vif-deleted:9e8db02a-f437-48df-a498-4ab55ec549fb for instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 on hv-cinder-74216 Jul 04 04:20:49.705603 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-5dde6408-15f9-485a-a241-f1fcbad0273b req-3ac818cc-ed56-4390-815a-9edab531f15b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030651 Jul 04 04:20:49.706235 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 351/686] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:20:49.974881 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f3be4f23-ee87-472a-858f-2cd1ecebdba8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:49.975494 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f3be4f23-ee87-472a-858f-2cd1ecebdba8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:49.982188 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3be4f23-ee87-472a-858f-2cd1ecebdba8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:49.982860 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3be4f23-ee87-472a-858f-2cd1ecebdba8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:49.983643 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3be4f23-ee87-472a-858f-2cd1ecebdba8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:49.984075 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3be4f23-ee87-472a-858f-2cd1ecebdba8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:50.016946 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3be4f23-ee87-472a-858f-2cd1ecebdba8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:50.017397 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3be4f23-ee87-472a-858f-2cd1ecebdba8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:50.017910 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-f3be4f23-ee87-472a-858f-2cd1ecebdba8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lazy-loading 'fault' on Instance uuid be90f3f9-d0dd-4296-ba6b-dc719d491a12 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:20:50.058465 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f3be4f23-ee87-472a-858f-2cd1ecebdba8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:50.062151 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:50.066973 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f3be4f23-ee87-472a-858f-2cd1ecebdba8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 200 len: 1330 microversion: 2.1 time: 0.095959 Jul 04 04:20:50.067520 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 336/687] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:49 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:50.327541 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a63c3347-000b-4977-a010-ee9e053a65cc tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:50.328241 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a63c3347-000b-4977-a010-ee9e053a65cc tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] [instance: fb07e282-565d-4780-b4e0-9fcc76ac5886] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:50.334961 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a63c3347-000b-4977-a010-ee9e053a65cc tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:50.335397 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a63c3347-000b-4977-a010-ee9e053a65cc tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:50.336188 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a63c3347-000b-4977-a010-ee9e053a65cc tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:50.336615 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a63c3347-000b-4977-a010-ee9e053a65cc tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:50.350677 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-a63c3347-000b-4977-a010-ee9e053a65cc tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] HTTP exception thrown: Instance fb07e282-565d-4780-b4e0-9fcc76ac5886 could not be found. Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a63c3347-000b-4977-a010-ee9e053a65cc tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Request method failure captured: Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 HTTP/1.1 Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmmBg8Nzi_-TnqjZ0XWNEuUrqbb5ZmuGP1CpHMpwof__8Epj-ewx1YK1FhX4l9W1cF_f3qioGP011qt8ztprQLQAGrZsNGYusPmBNaQsl9NQ4raZPH3aCnS1mwjnaKBFBgjxcRllCP5ak8rP1BoUbs7vx_ej9dTkls57WiAcXZ0hA1c Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: c487ee37e54042d680eccb72b046bb55 Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-TestMinimumBasicScenario-416866987 Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:20:50.352498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:20:50.353800 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c487ee37e54042d680eccb72b046bb55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c487ee37e54042d680eccb72b046bb55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c487ee37e54042d680eccb72b046bb55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c487ee37e54042d680eccb72b046bb55", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:20:50.353800 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-TestMinimumBasicScenario-416866987 Jul 04 04:20:50.353800 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: c487ee37e54042d680eccb72b046bb55 Jul 04 04:20:50.353800 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-TestMinimumBasicScenario-416866987 Jul 04 04:20:50.353800 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-TestMinimumBasicScenario-416866987-project Jul 04 04:20:50.353800 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:20:50.353800 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:20:50.353800 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 031fb205335f407bb2d275476b98fe24 Jul 04 04:20:50.353800 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-TestMinimumBasicScenario-416866987-project Jul 04 04:20:50.353800 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:20:50.353800 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance fb07e282-565d-4780-b4e0-9fcc76ac5886 could not be found. Jul 04 04:20:50.353800 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': 'fb07e282-565d-4780-b4e0-9fcc76ac5886'} Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb07e282-565d-4780-b4e0-9fcc76ac5886 could not be found. Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:20:50.354579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:20:50.356132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:20:50.356132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:20:50.356132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:20:50.356132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:20:50.356132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:20:50.356132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:20:50.356132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:20:50.356132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb07e282-565d-4780-b4e0-9fcc76ac5886 could not be found. Jul 04 04:20:50.356132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:20:50.356132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:20:50.356132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:20:50.356132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:20:50.356132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:20:50.356132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:20:50.356132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:20:50.356132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:20:50.356132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb07e282-565d-4780-b4e0-9fcc76ac5886 could not be found. Jul 04 04:20:50.356132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:20:50.357381 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a63c3347-000b-4977-a010-ee9e053a65cc tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Returning 404 to user: Instance fb07e282-565d-4780-b4e0-9fcc76ac5886 could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:20:50.357381 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a63c3347-000b-4977-a010-ee9e053a65cc tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886" status: 404 len: 111 microversion: 2.1 time: 0.031229 Jul 04 04:20:50.357381 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 352/688] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:50 2022] GET /compute/v2.1/servers/fb07e282-565d-4780-b4e0-9fcc76ac5886 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:20:50.363515 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-60e704c5-8e16-4cf8-b8e9-9b18d27a139c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] Calling method '.version_select at 0x7f50c1ba8280>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:50.383742 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-60e704c5-8e16-4cf8-b8e9-9b18d27a139c tempest-TestMinimumBasicScenario-416866987 tempest-TestMinimumBasicScenario-416866987-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-67529793" status: 202 len: 0 microversion: 2.1 time: 0.023998 Jul 04 04:20:50.384393 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 337/689] 10.222.0.16 () {58 vars in 1265 bytes} [Mon Jul 4 04:20:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-67529793 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:20:51.083777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-70b79a84-f457-4fbf-b71f-2a29e9c686c4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:51.084380 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-70b79a84-f457-4fbf-b71f-2a29e9c686c4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:51.090498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-70b79a84-f457-4fbf-b71f-2a29e9c686c4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:51.090944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-70b79a84-f457-4fbf-b71f-2a29e9c686c4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:51.091928 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-70b79a84-f457-4fbf-b71f-2a29e9c686c4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:51.092310 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-70b79a84-f457-4fbf-b71f-2a29e9c686c4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:51.105900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-70b79a84-f457-4fbf-b71f-2a29e9c686c4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] HTTP exception thrown: Instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 could not be found. Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-70b79a84-f457-4fbf-b71f-2a29e9c686c4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Request method failure captured: Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 HTTP/1.1 Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmkvvNXviK4RHs-pC2ZUGxhjzRMF8G1iwt3QQvENmXB_WKs6Un0uo-bkU60UeA5mbFaWI8DULlMS96BRMKHcqOYLorEFYdRp34ZJFtZG4dJDmi0fE-jBVj7rCHrbsjhLZ51yhgpFUDC-ASYnpBPbmkcyUWrK8JyNvv4uGci2lLUQkr4 Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:20:51.107524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:20:51.108973 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ccd298eebe6413daaae0d801e902616", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:20:51.108973 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:20:51.108973 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:20:51.108973 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:20:51.108973 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:20:51.108973 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:20:51.108973 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:20:51.108973 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 4041faa2919d4760ae10907070a10dc7 Jul 04 04:20:51.108973 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:20:51.108973 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:20:51.108973 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 could not be found. Jul 04 04:20:51.108973 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': 'be90f3f9-d0dd-4296-ba6b-dc719d491a12'} Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 could not be found. Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:20:51.109803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:20:51.111014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:20:51.111014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:20:51.111014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:20:51.111014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:20:51.111014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:20:51.111014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:20:51.111014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:20:51.111014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 could not be found. Jul 04 04:20:51.111014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:20:51.111014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:20:51.111014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:20:51.111014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:20:51.111014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:20:51.111014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:20:51.111014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:20:51.111014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:20:51.111014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 could not be found. Jul 04 04:20:51.111014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:20:51.112047 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-70b79a84-f457-4fbf-b71f-2a29e9c686c4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Returning 404 to user: Instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:20:51.112047 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-70b79a84-f457-4fbf-b71f-2a29e9c686c4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 404 len: 111 microversion: 2.1 time: 0.029212 Jul 04 04:20:51.112047 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 353/690] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:51 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:20:51.118776 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5c8e9da3-990a-4bc5-b688-fa794642701a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '.version_select at 0x7f50c0fd43a0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:51.135987 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5c8e9da3-990a-4bc5-b688-fa794642701a tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985432091" status: 202 len: 0 microversion: 2.1 time: 0.021735 Jul 04 04:20:51.136561 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 338/691] 10.222.0.16 () {58 vars in 1220 bytes} [Mon Jul 4 04:20:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985432091 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:20:52.030093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3c67cbfa-25b6-4771-adf9-cf64e0299d8f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Action: 'create', calling method: .version_select at 0x7f50c1046670>, body: {"keypair": {"name": "tempest-keypair-36021855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAS9V3mXTlj+nNaN7sek6gSNP1pyEOyWOpTUT1CPruRa5p5yeMaakB96XF4YAZ43782XjmDAR0/yXks2eSIsMbaebuJ7TsCBsv8ibGFFPuUrFQRQVjspv40nttexwSAxUw=="}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:20:52.044860 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-3c67cbfa-25b6-4771-adf9-cf64e0299d8f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Getting quotas for project 7ccd298eebe6413daaae0d801e902616. Resources: {'key_pairs'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:20:52.048883 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-3c67cbfa-25b6-4771-adf9-cf64e0299d8f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Getting quotas for user 4041faa2919d4760ae10907070a10dc7 and project 7ccd298eebe6413daaae0d801e902616. Resources: {'key_pairs'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:20:52.065126 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3c67cbfa-25b6-4771-adf9-cf64e0299d8f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [238599e7-9be1-4a52-90cc-3dd4f5563fed] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 04 04:20:53.072123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO oslo.messaging._drivers.impl_rabbit [None req-3c67cbfa-25b6-4771-adf9-cf64e0299d8f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [238599e7-9be1-4a52-90cc-3dd4f5563fed] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56186. Jul 04 04:20:53.094505 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3c67cbfa-25b6-4771-adf9-cf64e0299d8f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 1.065891 Jul 04 04:20:53.094505 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 354/692] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jul 4 04:20:52 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:20:54.422213 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ebe4af0b-8a8f-4a27-b867-783cd9383cda tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-982892015", "imageRef": "46b9937d-f997-401a-a3aa-bb9028764454", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0e412eaf-c623-4c5a-9f62-8e6b8ef74b11"}], "security_groups": [{"name": "tempest-securitygroup--2131049562"}], "key_name": "tempest-keypair-36021855", "user_data": "}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:20:54.567626 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-ebe4af0b-8a8f-4a27-b867-783cd9383cda tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] validate_networks() for [('0e412eaf-c623-4c5a-9f62-8e6b8ef74b11', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:20:55.354466 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-ebe4af0b-8a8f-4a27-b867-783cd9383cda tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:20:55.354896 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-ebe4af0b-8a8f-4a27-b867-783cd9383cda tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:20:55.355379 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-ebe4af0b-8a8f-4a27-b867-783cd9383cda tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:20:55.355884 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-ebe4af0b-8a8f-4a27-b867-783cd9383cda tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:20:55.356305 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-ebe4af0b-8a8f-4a27-b867-783cd9383cda tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:20:55.366026 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ebe4af0b-8a8f-4a27-b867-783cd9383cda tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:55.366480 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ebe4af0b-8a8f-4a27-b867-783cd9383cda tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:55.367285 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ebe4af0b-8a8f-4a27-b867-783cd9383cda tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:55.367719 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ebe4af0b-8a8f-4a27-b867-783cd9383cda tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:55.385491 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-ebe4af0b-8a8f-4a27-b867-783cd9383cda tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Getting quotas for project 7ccd298eebe6413daaae0d801e902616. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:20:55.390129 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-ebe4af0b-8a8f-4a27-b867-783cd9383cda tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Getting quotas for user 4041faa2919d4760ae10907070a10dc7 and project 7ccd298eebe6413daaae0d801e902616. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:20:55.401642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ebe4af0b-8a8f-4a27-b867-783cd9383cda tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:20:55.404564 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ebe4af0b-8a8f-4a27-b867-783cd9383cda tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46b9937d-f997-401a-a3aa-bb9028764454',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:20:55.456011 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ebe4af0b-8a8f-4a27-b867-783cd9383cda tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.038655 Jul 04 04:20:55.456893 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 339/693] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:20:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 04:20:55.466943 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b2d9002e-ba55-4667-9631-9ede8457951d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:55.467789 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b2d9002e-ba55-4667-9631-9ede8457951d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:55.524616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b2d9002e-ba55-4667-9631-9ede8457951d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:55.532354 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b2d9002e-ba55-4667-9631-9ede8457951d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 200 len: 1239 microversion: 2.1 time: 0.069482 Jul 04 04:20:55.533005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 355/694] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:55 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:56.550208 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6a9bb1fe-24b5-42e6-b6df-f3bb34f55539 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:56.550925 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6a9bb1fe-24b5-42e6-b6df-f3bb34f55539 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:56.630504 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6a9bb1fe-24b5-42e6-b6df-f3bb34f55539 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:56.640464 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6a9bb1fe-24b5-42e6-b6df-f3bb34f55539 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 200 len: 1239 microversion: 2.1 time: 0.094575 Jul 04 04:20:56.641092 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 340/695] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:56 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 1239 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:57.657250 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ba3ee456-865b-4fae-b202-ca73f4332e5c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:57.657960 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-ba3ee456-865b-4fae-b202-ca73f4332e5c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:57.726387 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-ba3ee456-865b-4fae-b202-ca73f4332e5c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:57.742151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ba3ee456-865b-4fae-b202-ca73f4332e5c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 200 len: 1239 microversion: 2.1 time: 0.088925 Jul 04 04:20:57.742921 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 356/696] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:57 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 1239 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:58.759406 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-76f20391-61d7-4345-badb-1379694f1ee9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:58.760023 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-76f20391-61d7-4345-badb-1379694f1ee9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:58.831063 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-76f20391-61d7-4345-badb-1379694f1ee9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:58.844529 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-76f20391-61d7-4345-badb-1379694f1ee9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 200 len: 1239 microversion: 2.1 time: 0.088983 Jul 04 04:20:58.853596 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 341/697] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:58 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 1239 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:20:59.863185 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-31c86431-2954-42d1-902a-5fdc67b91bbe tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:20:59.863976 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-31c86431-2954-42d1-902a-5fdc67b91bbe tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:20:59.872967 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-31c86431-2954-42d1-902a-5fdc67b91bbe tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:59.873569 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-31c86431-2954-42d1-902a-5fdc67b91bbe tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:59.874634 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-31c86431-2954-42d1-902a-5fdc67b91bbe tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:20:59.875193 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-31c86431-2954-42d1-902a-5fdc67b91bbe tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:20:59.942172 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-31c86431-2954-42d1-902a-5fdc67b91bbe tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:20:59.950046 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-31c86431-2954-42d1-902a-5fdc67b91bbe tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 200 len: 1243 microversion: 2.1 time: 0.091958 Jul 04 04:20:59.950660 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 357/698] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:20:59 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 1243 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:00.967405 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0df9fd94-676f-4f0e-8347-4c352741a6d4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:00.968017 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0df9fd94-676f-4f0e-8347-4c352741a6d4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:00.974699 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0df9fd94-676f-4f0e-8347-4c352741a6d4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:00.975152 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0df9fd94-676f-4f0e-8347-4c352741a6d4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:00.975930 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0df9fd94-676f-4f0e-8347-4c352741a6d4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:00.976370 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0df9fd94-676f-4f0e-8347-4c352741a6d4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:01.049941 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0df9fd94-676f-4f0e-8347-4c352741a6d4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:01.057807 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0df9fd94-676f-4f0e-8347-4c352741a6d4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 200 len: 1297 microversion: 2.1 time: 0.094446 Jul 04 04:21:01.058347 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 342/699] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:00 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 1297 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:02.075253 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-bdfadab6-2033-4e0e-9182-dc26b269d1b1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:02.077779 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-bdfadab6-2033-4e0e-9182-dc26b269d1b1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:02.084948 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bdfadab6-2033-4e0e-9182-dc26b269d1b1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:02.085642 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bdfadab6-2033-4e0e-9182-dc26b269d1b1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:02.087389 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bdfadab6-2033-4e0e-9182-dc26b269d1b1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:02.088141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bdfadab6-2033-4e0e-9182-dc26b269d1b1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:02.094145 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-f67b0083-b84c-4ab7-9810-3e49b6f19cb6 req-59852ac9-7224-4ca9-b95f-da2e43193e6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8504f7ec-3a32-4230-ad65-61da993f52bb", "tag": "7051c212-d0bc-4b65-80eb-a9c6d3fd89c4"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:21:02.124607 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-f67b0083-b84c-4ab7-9810-3e49b6f19cb6 req-59852ac9-7224-4ca9-b95f-da2e43193e6e service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:02.125721 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-f67b0083-b84c-4ab7-9810-3e49b6f19cb6 req-59852ac9-7224-4ca9-b95f-da2e43193e6e service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:02.143891 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-f67b0083-b84c-4ab7-9810-3e49b6f19cb6 req-59852ac9-7224-4ca9-b95f-da2e43193e6e service nova] Creating event network-changed:7051c212-d0bc-4b65-80eb-a9c6d3fd89c4 for instance 8504f7ec-3a32-4230-ad65-61da993f52bb on hv-cinder-74216 Jul 04 04:21:02.153561 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-f67b0083-b84c-4ab7-9810-3e49b6f19cb6 req-59852ac9-7224-4ca9-b95f-da2e43193e6e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066223 Jul 04 04:21:02.154684 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 343/700] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:21:02.247958 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-bdfadab6-2033-4e0e-9182-dc26b269d1b1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:02.256120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-bdfadab6-2033-4e0e-9182-dc26b269d1b1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 200 len: 1365 microversion: 2.1 time: 0.184651 Jul 04 04:21:02.256706 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 358/701] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:02 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:03.277683 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-81f98e26-a5e2-4ed1-8dff-809ca9ed013c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:03.279177 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-81f98e26-a5e2-4ed1-8dff-809ca9ed013c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:03.288381 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81f98e26-a5e2-4ed1-8dff-809ca9ed013c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:03.288984 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81f98e26-a5e2-4ed1-8dff-809ca9ed013c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:03.290096 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81f98e26-a5e2-4ed1-8dff-809ca9ed013c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:03.290636 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81f98e26-a5e2-4ed1-8dff-809ca9ed013c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:03.436970 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-81f98e26-a5e2-4ed1-8dff-809ca9ed013c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:03.446825 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-81f98e26-a5e2-4ed1-8dff-809ca9ed013c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 200 len: 1365 microversion: 2.1 time: 0.175450 Jul 04 04:21:03.447622 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 344/702] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:03 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:04.465305 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-724b3151-677d-4a07-b359-0d2f52f7321e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:04.465893 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-724b3151-677d-4a07-b359-0d2f52f7321e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:04.473283 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-724b3151-677d-4a07-b359-0d2f52f7321e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:04.473736 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-724b3151-677d-4a07-b359-0d2f52f7321e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:04.474535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-724b3151-677d-4a07-b359-0d2f52f7321e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:04.474968 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-724b3151-677d-4a07-b359-0d2f52f7321e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:04.619729 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-724b3151-677d-4a07-b359-0d2f52f7321e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:04.627495 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-724b3151-677d-4a07-b359-0d2f52f7321e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 200 len: 1365 microversion: 2.1 time: 0.166248 Jul 04 04:21:04.628036 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 359/703] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:04 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:05.645227 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3bbfbe4c-48d9-4fe6-8272-3608440549a4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:05.645862 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3bbfbe4c-48d9-4fe6-8272-3608440549a4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:05.648441 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:05.654138 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3bbfbe4c-48d9-4fe6-8272-3608440549a4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:05.654634 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3bbfbe4c-48d9-4fe6-8272-3608440549a4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:05.655384 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3bbfbe4c-48d9-4fe6-8272-3608440549a4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:05.655819 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3bbfbe4c-48d9-4fe6-8272-3608440549a4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:05.801709 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3bbfbe4c-48d9-4fe6-8272-3608440549a4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:05.809432 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3bbfbe4c-48d9-4fe6-8272-3608440549a4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 200 len: 1365 microversion: 2.1 time: 0.168200 Jul 04 04:21:05.810066 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 345/704] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:05 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:06.828966 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-212a0821-7a54-420d-91ef-7d092cd4bc26 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:06.829713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-212a0821-7a54-420d-91ef-7d092cd4bc26 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:06.838195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-212a0821-7a54-420d-91ef-7d092cd4bc26 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:06.838686 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-212a0821-7a54-420d-91ef-7d092cd4bc26 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:06.839637 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-212a0821-7a54-420d-91ef-7d092cd4bc26 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:06.840142 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-212a0821-7a54-420d-91ef-7d092cd4bc26 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:06.977651 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-212a0821-7a54-420d-91ef-7d092cd4bc26 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:06.986492 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-212a0821-7a54-420d-91ef-7d092cd4bc26 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 200 len: 1365 microversion: 2.1 time: 0.162470 Jul 04 04:21:06.987138 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 360/705] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:06 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:08.006299 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-50a0f224-defe-4436-b676-4c404a3f4433 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:08.006911 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-50a0f224-defe-4436-b676-4c404a3f4433 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:08.009290 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:08.015213 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50a0f224-defe-4436-b676-4c404a3f4433 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:08.015661 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50a0f224-defe-4436-b676-4c404a3f4433 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:08.016435 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50a0f224-defe-4436-b676-4c404a3f4433 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:08.016859 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-50a0f224-defe-4436-b676-4c404a3f4433 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:08.166086 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-50a0f224-defe-4436-b676-4c404a3f4433 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:08.175484 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-50a0f224-defe-4436-b676-4c404a3f4433 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 200 len: 1365 microversion: 2.1 time: 0.173033 Jul 04 04:21:08.176148 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 346/706] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:08 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:08.374785 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=8 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:08.556384 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-1ee6ae5f-dac2-43bd-a30d-8f368cbee25c req-924b88b0-9e50-44a7-ba48-fe8a6c1d2a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8504f7ec-3a32-4230-ad65-61da993f52bb", "name": "network-vif-plugged", "status": "completed", "tag": "7051c212-d0bc-4b65-80eb-a9c6d3fd89c4"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:21:08.559923 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:08.565682 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-1ee6ae5f-dac2-43bd-a30d-8f368cbee25c req-924b88b0-9e50-44a7-ba48-fe8a6c1d2a8c service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:08.566118 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-1ee6ae5f-dac2-43bd-a30d-8f368cbee25c req-924b88b0-9e50-44a7-ba48-fe8a6c1d2a8c service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:08.577588 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-1ee6ae5f-dac2-43bd-a30d-8f368cbee25c req-924b88b0-9e50-44a7-ba48-fe8a6c1d2a8c service nova] Creating event network-vif-plugged:7051c212-d0bc-4b65-80eb-a9c6d3fd89c4 for instance 8504f7ec-3a32-4230-ad65-61da993f52bb on hv-cinder-74216 Jul 04 04:21:08.582889 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-1ee6ae5f-dac2-43bd-a30d-8f368cbee25c req-924b88b0-9e50-44a7-ba48-fe8a6c1d2a8c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212998 Jul 04 04:21:08.583507 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 361/707] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:21:09.193623 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f76137fb-fc97-4e0c-a481-6ef17a9e12cb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:09.194196 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f76137fb-fc97-4e0c-a481-6ef17a9e12cb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:09.196133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=10 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:09.202709 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f76137fb-fc97-4e0c-a481-6ef17a9e12cb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:09.203161 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f76137fb-fc97-4e0c-a481-6ef17a9e12cb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:09.203925 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f76137fb-fc97-4e0c-a481-6ef17a9e12cb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:09.204356 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f76137fb-fc97-4e0c-a481-6ef17a9e12cb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:09.339663 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f76137fb-fc97-4e0c-a481-6ef17a9e12cb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:09.348487 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f76137fb-fc97-4e0c-a481-6ef17a9e12cb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 200 len: 1365 microversion: 2.1 time: 0.158649 Jul 04 04:21:09.349216 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 347/708] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:09 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:10.369030 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-63dc5853-8f75-428e-aa10-f8360cd56811 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:10.369603 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-63dc5853-8f75-428e-aa10-f8360cd56811 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:10.376764 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-63dc5853-8f75-428e-aa10-f8360cd56811 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:10.377230 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-63dc5853-8f75-428e-aa10-f8360cd56811 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:10.377986 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-63dc5853-8f75-428e-aa10-f8360cd56811 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:10.378413 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-63dc5853-8f75-428e-aa10-f8360cd56811 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:10.514747 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-63dc5853-8f75-428e-aa10-f8360cd56811 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:10.523323 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-63dc5853-8f75-428e-aa10-f8360cd56811 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 200 len: 1365 microversion: 2.1 time: 0.159478 Jul 04 04:21:10.523922 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 362/709] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:10 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:11.543741 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ef15d446-61d7-418c-a381-ad00f241c986 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:11.544536 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ef15d446-61d7-418c-a381-ad00f241c986 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:11.553200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef15d446-61d7-418c-a381-ad00f241c986 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:11.553647 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef15d446-61d7-418c-a381-ad00f241c986 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:11.554404 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef15d446-61d7-418c-a381-ad00f241c986 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:11.554868 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef15d446-61d7-418c-a381-ad00f241c986 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:11.706275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ef15d446-61d7-418c-a381-ad00f241c986 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:11.714464 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ef15d446-61d7-418c-a381-ad00f241c986 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 200 len: 1555 microversion: 2.1 time: 0.175983 Jul 04 04:21:11.715036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 348/710] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:11 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:11.731994 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-85a71a45-3922-4e58-98d2-1ce9469e7db1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:11.732695 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-85a71a45-3922-4e58-98d2-1ce9469e7db1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:11.739288 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-85a71a45-3922-4e58-98d2-1ce9469e7db1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:11.739738 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-85a71a45-3922-4e58-98d2-1ce9469e7db1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:11.740500 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-85a71a45-3922-4e58-98d2-1ce9469e7db1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:11.740934 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-85a71a45-3922-4e58-98d2-1ce9469e7db1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:11.827586 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-85a71a45-3922-4e58-98d2-1ce9469e7db1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100255 Jul 04 04:21:11.828344 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 363/711] 10.222.0.16 () {58 vars in 1274 bytes} [Mon Jul 4 04:21:11 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:21:12.860540 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-ec319179-5a2f-4c36-b4b5-7e4c6d6ba142 req-d62e2b36-3362-4acb-ad1f-84330c0a728f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8504f7ec-3a32-4230-ad65-61da993f52bb", "tag": "7051c212-d0bc-4b65-80eb-a9c6d3fd89c4"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:21:12.871435 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ec319179-5a2f-4c36-b4b5-7e4c6d6ba142 req-d62e2b36-3362-4acb-ad1f-84330c0a728f service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:12.871866 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ec319179-5a2f-4c36-b4b5-7e4c6d6ba142 req-d62e2b36-3362-4acb-ad1f-84330c0a728f service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:12.889519 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-ec319179-5a2f-4c36-b4b5-7e4c6d6ba142 req-d62e2b36-3362-4acb-ad1f-84330c0a728f service nova] Creating event network-changed:7051c212-d0bc-4b65-80eb-a9c6d3fd89c4 for instance 8504f7ec-3a32-4230-ad65-61da993f52bb on hv-cinder-74216 Jul 04 04:21:12.895002 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-ec319179-5a2f-4c36-b4b5-7e4c6d6ba142 req-d62e2b36-3362-4acb-ad1f-84330c0a728f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039850 Jul 04 04:21:12.896119 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 349/712] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:21:19.703071 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-cb4b8af4-18e9-46fa-817d-e0b8f7cff362 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:19.703597 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-cb4b8af4-18e9-46fa-817d-e0b8f7cff362 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:19.710253 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cb4b8af4-18e9-46fa-817d-e0b8f7cff362 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:19.710746 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cb4b8af4-18e9-46fa-817d-e0b8f7cff362 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:19.711506 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cb4b8af4-18e9-46fa-817d-e0b8f7cff362 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:19.711959 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cb4b8af4-18e9-46fa-817d-e0b8f7cff362 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:19.714650 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=53 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:19.813779 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.objects.instance [None req-cb4b8af4-18e9-46fa-817d-e0b8f7cff362 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lazy-loading 'services' on Instance uuid cfaa8d9e-b400-45d9-a635-3916ec760c32 {{(pid=117875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:21:19.903016 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-cb4b8af4-18e9-46fa-817d-e0b8f7cff362 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/os-volume_attachments/a55e874c-f8a8-43e8-b2f9-9ae7f0b91f70" status: 202 len: 0 microversion: 2.1 time: 0.204432 Jul 04 04:21:19.903651 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 364/713] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jul 4 04:21:19 2022] DELETE /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/os-volume_attachments/a55e874c-f8a8-43e8-b2f9-9ae7f0b91f70 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:21:19.914424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9508cba5-c28b-4588-b4fa-1282e01ba5ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:19.915159 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9508cba5-c28b-4588-b4fa-1282e01ba5ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:19.922408 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9508cba5-c28b-4588-b4fa-1282e01ba5ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:19.922875 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9508cba5-c28b-4588-b4fa-1282e01ba5ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:19.924100 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9508cba5-c28b-4588-b4fa-1282e01ba5ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:19.924331 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9508cba5-c28b-4588-b4fa-1282e01ba5ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:19.957854 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9508cba5-c28b-4588-b4fa-1282e01ba5ba tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047153 Jul 04 04:21:19.958474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 350/714] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:21:19 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:21:20.972380 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e31913a0-6504-4f05-8ea9-de60611818e1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:20.973468 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e31913a0-6504-4f05-8ea9-de60611818e1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:20.979885 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e31913a0-6504-4f05-8ea9-de60611818e1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:20.980350 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e31913a0-6504-4f05-8ea9-de60611818e1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:20.981112 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e31913a0-6504-4f05-8ea9-de60611818e1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:20.981542 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e31913a0-6504-4f05-8ea9-de60611818e1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:21.014214 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e31913a0-6504-4f05-8ea9-de60611818e1 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047717 Jul 04 04:21:21.014719 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 365/715] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:21:20 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:21:22.027059 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ee12ba08-dd10-4baa-b9d0-0e1340bfba6b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:22.028151 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ee12ba08-dd10-4baa-b9d0-0e1340bfba6b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:22.035496 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee12ba08-dd10-4baa-b9d0-0e1340bfba6b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:22.035946 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee12ba08-dd10-4baa-b9d0-0e1340bfba6b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:22.036738 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee12ba08-dd10-4baa-b9d0-0e1340bfba6b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:22.037176 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee12ba08-dd10-4baa-b9d0-0e1340bfba6b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:22.039797 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=49 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:22.067014 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ee12ba08-dd10-4baa-b9d0-0e1340bfba6b tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043934 Jul 04 04:21:22.067574 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 351/716] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:21:22 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 04:21:22.140979 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a14c2824-587c-4fcb-a234-86e0b9a64751 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:22.141515 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a14c2824-587c-4fcb-a234-86e0b9a64751 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:22.148211 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a14c2824-587c-4fcb-a234-86e0b9a64751 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:22.148660 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a14c2824-587c-4fcb-a234-86e0b9a64751 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:22.149423 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a14c2824-587c-4fcb-a234-86e0b9a64751 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:22.149856 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a14c2824-587c-4fcb-a234-86e0b9a64751 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:22.177873 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a14c2824-587c-4fcb-a234-86e0b9a64751 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Going to try to terminate instance {{(pid=117875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:21:22.275266 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a14c2824-587c-4fcb-a234-86e0b9a64751 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 204 len: 0 microversion: 2.1 time: 0.137979 Jul 04 04:21:22.276253 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 366/717] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:21:22 2022] DELETE /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:21:22.288317 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4b5976b9-fa91-4c69-9d8c-4f87be7d7563 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:22.288879 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4b5976b9-fa91-4c69-9d8c-4f87be7d7563 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:22.295185 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b5976b9-fa91-4c69-9d8c-4f87be7d7563 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:22.295641 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b5976b9-fa91-4c69-9d8c-4f87be7d7563 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:22.296405 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b5976b9-fa91-4c69-9d8c-4f87be7d7563 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:22.296840 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b5976b9-fa91-4c69-9d8c-4f87be7d7563 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:22.440948 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4b5976b9-fa91-4c69-9d8c-4f87be7d7563 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:22.449203 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4b5976b9-fa91-4c69-9d8c-4f87be7d7563 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1688 microversion: 2.1 time: 0.165164 Jul 04 04:21:22.449781 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 352/718] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:22 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:23.470924 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-71923180-419f-48ef-ac15-7649e73b7615 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:23.472730 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-71923180-419f-48ef-ac15-7649e73b7615 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:23.481720 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-71923180-419f-48ef-ac15-7649e73b7615 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:23.482280 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-71923180-419f-48ef-ac15-7649e73b7615 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:23.483289 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-71923180-419f-48ef-ac15-7649e73b7615 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:23.483843 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-71923180-419f-48ef-ac15-7649e73b7615 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:23.627321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-71923180-419f-48ef-ac15-7649e73b7615 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:23.638676 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-71923180-419f-48ef-ac15-7649e73b7615 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1688 microversion: 2.1 time: 0.174812 Jul 04 04:21:23.639423 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 367/719] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:23 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:24.659519 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5e329b7a-d03c-4e8d-a8c1-20cdf8e53cc9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:24.660421 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5e329b7a-d03c-4e8d-a8c1-20cdf8e53cc9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:24.668390 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e329b7a-d03c-4e8d-a8c1-20cdf8e53cc9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:24.668799 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e329b7a-d03c-4e8d-a8c1-20cdf8e53cc9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:24.669607 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e329b7a-d03c-4e8d-a8c1-20cdf8e53cc9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:24.670046 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e329b7a-d03c-4e8d-a8c1-20cdf8e53cc9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:24.803786 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5e329b7a-d03c-4e8d-a8c1-20cdf8e53cc9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:24.815419 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5e329b7a-d03c-4e8d-a8c1-20cdf8e53cc9 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1688 microversion: 2.1 time: 0.162180 Jul 04 04:21:24.816226 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 353/720] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:24 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:25.833603 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-74491f91-b3ea-4a86-9683-fd85f968da60 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:25.834210 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-74491f91-b3ea-4a86-9683-fd85f968da60 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:25.841385 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-74491f91-b3ea-4a86-9683-fd85f968da60 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:25.841837 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-74491f91-b3ea-4a86-9683-fd85f968da60 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:25.842645 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-74491f91-b3ea-4a86-9683-fd85f968da60 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:25.843080 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-74491f91-b3ea-4a86-9683-fd85f968da60 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:25.982115 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-74491f91-b3ea-4a86-9683-fd85f968da60 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:25.992837 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-74491f91-b3ea-4a86-9683-fd85f968da60 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1688 microversion: 2.1 time: 0.163279 Jul 04 04:21:25.993450 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 368/721] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:25 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:27.009219 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d95a9d16-15ec-4d9a-bc52-84fe4e61c1a8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:27.009850 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d95a9d16-15ec-4d9a-bc52-84fe4e61c1a8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:27.016750 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d95a9d16-15ec-4d9a-bc52-84fe4e61c1a8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:27.017447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d95a9d16-15ec-4d9a-bc52-84fe4e61c1a8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:27.018222 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d95a9d16-15ec-4d9a-bc52-84fe4e61c1a8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:27.018709 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d95a9d16-15ec-4d9a-bc52-84fe4e61c1a8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:27.137462 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d95a9d16-15ec-4d9a-bc52-84fe4e61c1a8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:27.145396 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d95a9d16-15ec-4d9a-bc52-84fe4e61c1a8 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 200 len: 1620 microversion: 2.1 time: 0.140161 Jul 04 04:21:27.146026 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 354/722] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:27 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 1620 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:27.224607 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-62c1f2f3-be30-4078-803a-c0f6eee18ed8 req-59576878-a9e6-493d-be43-f0055b284c3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfaa8d9e-b400-45d9-a635-3916ec760c32", "name": "network-vif-deleted", "tag": "e37866cf-542d-489f-93a0-a1d504eaec14"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:21:27.234013 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-62c1f2f3-be30-4078-803a-c0f6eee18ed8 req-59576878-a9e6-493d-be43-f0055b284c3b service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:27.234474 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-62c1f2f3-be30-4078-803a-c0f6eee18ed8 req-59576878-a9e6-493d-be43-f0055b284c3b service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:27.248369 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-62c1f2f3-be30-4078-803a-c0f6eee18ed8 req-59576878-a9e6-493d-be43-f0055b284c3b service nova] Creating event network-vif-deleted:e37866cf-542d-489f-93a0-a1d504eaec14 for instance cfaa8d9e-b400-45d9-a635-3916ec760c32 on hv-cinder-74216 Jul 04 04:21:27.255815 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-62c1f2f3-be30-4078-803a-c0f6eee18ed8 req-59576878-a9e6-493d-be43-f0055b284c3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034904 Jul 04 04:21:27.256605 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 369/723] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:21:27.748627 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f6a8d25b-9a2f-4f04-b922-8483f2e3a10a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:27.749552 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f6a8d25b-9a2f-4f04-b922-8483f2e3a10a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:27.756947 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6a8d25b-9a2f-4f04-b922-8483f2e3a10a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:27.757502 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6a8d25b-9a2f-4f04-b922-8483f2e3a10a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:27.758310 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6a8d25b-9a2f-4f04-b922-8483f2e3a10a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:27.758787 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6a8d25b-9a2f-4f04-b922-8483f2e3a10a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:27.786061 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f6a8d25b-9a2f-4f04-b922-8483f2e3a10a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:21:27.869253 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f6a8d25b-9a2f-4f04-b922-8483f2e3a10a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 204 len: 0 microversion: 2.1 time: 0.125248 Jul 04 04:21:27.870262 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 355/724] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:21:27 2022] DELETE /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:21:27.880565 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ea815c0d-3eaf-4bd6-8185-7cef94deef31 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:27.881520 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-ea815c0d-3eaf-4bd6-8185-7cef94deef31 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:27.889118 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ea815c0d-3eaf-4bd6-8185-7cef94deef31 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:27.889573 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ea815c0d-3eaf-4bd6-8185-7cef94deef31 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:27.890650 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ea815c0d-3eaf-4bd6-8185-7cef94deef31 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:27.891129 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ea815c0d-3eaf-4bd6-8185-7cef94deef31 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:28.031451 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-ea815c0d-3eaf-4bd6-8185-7cef94deef31 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:28.040389 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ea815c0d-3eaf-4bd6-8185-7cef94deef31 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1576 microversion: 2.1 time: 0.164928 Jul 04 04:21:28.040696 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 370/725] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:27 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:21:28.164010 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-89165dd0-97e8-4202-b21f-12bf4ebba685 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:28.164741 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-89165dd0-97e8-4202-b21f-12bf4ebba685 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: cfaa8d9e-b400-45d9-a635-3916ec760c32] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:28.172030 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89165dd0-97e8-4202-b21f-12bf4ebba685 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:28.172480 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89165dd0-97e8-4202-b21f-12bf4ebba685 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:28.173274 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89165dd0-97e8-4202-b21f-12bf4ebba685 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:28.173711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89165dd0-97e8-4202-b21f-12bf4ebba685 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:28.188663 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-89165dd0-97e8-4202-b21f-12bf4ebba685 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] HTTP exception thrown: Instance cfaa8d9e-b400-45d9-a635-3916ec760c32 could not be found. Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-89165dd0-97e8-4202-b21f-12bf4ebba685 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Request method failure captured: Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 HTTP/1.1 Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmktGFBnwxVIACZValM9F_vrhCgFSRvMfNRwtdrHKuyEsmF4aiq464pUWCHoMBUPvBNYcADpX-2vxT_KraK3ReDT4FVftgwsiJAXYCECV12XOYlbBVQ1ZYULfr056xZkZOy4W69n1sC16SqMpBplnzVOrH2eQH8bDSp-6KdyeIq-sHU Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 7ea328a1154a4a9a955e411f7eab0aa9 Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1922475267 Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:21:28.190725 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:21:28.192229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ea328a1154a4a9a955e411f7eab0aa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ea328a1154a4a9a955e411f7eab0aa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ea328a1154a4a9a955e411f7eab0aa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ea328a1154a4a9a955e411f7eab0aa9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:21:28.192229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1922475267 Jul 04 04:21:28.192229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 7ea328a1154a4a9a955e411f7eab0aa9 Jul 04 04:21:28.192229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1922475267 Jul 04 04:21:28.192229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-ServerRescueNegativeTestJSON-1922475267-project Jul 04 04:21:28.192229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:21:28.192229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:21:28.192229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: dca54bc220104e79aa727f30399f3411 Jul 04 04:21:28.192229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1922475267-project Jul 04 04:21:28.192229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:21:28.192229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance cfaa8d9e-b400-45d9-a635-3916ec760c32 could not be found. Jul 04 04:21:28.192229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': 'cfaa8d9e-b400-45d9-a635-3916ec760c32'} Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfaa8d9e-b400-45d9-a635-3916ec760c32 could not be found. Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:21:28.193109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:21:28.194348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:21:28.194348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:21:28.194348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:21:28.194348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:21:28.194348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:21:28.194348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:21:28.194348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:21:28.194348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfaa8d9e-b400-45d9-a635-3916ec760c32 could not be found. Jul 04 04:21:28.194348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:28.194348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:21:28.194348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:28.194348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:21:28.194348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:21:28.194348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:21:28.194348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:21:28.194348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:21:28.194348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfaa8d9e-b400-45d9-a635-3916ec760c32 could not be found. Jul 04 04:21:28.194348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:28.195483 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-89165dd0-97e8-4202-b21f-12bf4ebba685 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Returning 404 to user: Instance cfaa8d9e-b400-45d9-a635-3916ec760c32 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:21:28.195483 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-89165dd0-97e8-4202-b21f-12bf4ebba685 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32" status: 404 len: 111 microversion: 2.1 time: 0.032676 Jul 04 04:21:28.195483 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 356/726] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:28 2022] GET /compute/v2.1/servers/cfaa8d9e-b400-45d9-a635-3916ec760c32 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:21:28.201344 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-60d4de95-eaea-4334-a3a6-ee268cd9f848 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '.version_select at 0x7f50c1152280>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:28.222837 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-60d4de95-eaea-4334-a3a6-ee268cd9f848 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-264423189" status: 202 len: 0 microversion: 2.1 time: 0.025374 Jul 04 04:21:28.223473 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 371/727] 10.222.0.16 () {58 vars in 1217 bytes} [Mon Jul 4 04:21:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-264423189 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:21:29.061860 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9c631c1f-134c-4191-9dbb-9114c437cf73 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:29.062769 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9c631c1f-134c-4191-9dbb-9114c437cf73 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:29.072064 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c631c1f-134c-4191-9dbb-9114c437cf73 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:29.072515 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c631c1f-134c-4191-9dbb-9114c437cf73 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:29.073283 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c631c1f-134c-4191-9dbb-9114c437cf73 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:29.073712 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c631c1f-134c-4191-9dbb-9114c437cf73 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:29.226951 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9c631c1f-134c-4191-9dbb-9114c437cf73 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:29.235049 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9c631c1f-134c-4191-9dbb-9114c437cf73 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1576 microversion: 2.1 time: 0.179882 Jul 04 04:21:29.235597 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 357/728] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:29 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:30.253582 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-35d738de-4592-459e-ab22-7b12c1c59412 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:30.254205 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-35d738de-4592-459e-ab22-7b12c1c59412 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:30.264293 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-35d738de-4592-459e-ab22-7b12c1c59412 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:30.264293 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-35d738de-4592-459e-ab22-7b12c1c59412 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:30.265014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-35d738de-4592-459e-ab22-7b12c1c59412 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:30.265457 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-35d738de-4592-459e-ab22-7b12c1c59412 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:30.348119 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-35d738de-4592-459e-ab22-7b12c1c59412 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:30.362436 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-35d738de-4592-459e-ab22-7b12c1c59412 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1509 microversion: 2.1 time: 0.112736 Jul 04 04:21:30.368400 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 372/729] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:30 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1509 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:30.553264 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-f1ef983a-5c92-4913-8d02-898b78202dd2 req-92d55fdd-5353-48ee-a939-61341d0eb6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc36b6d5-12c0-48bd-9aee-afdef9e38c2d", "name": "network-vif-deleted", "tag": "f0229d6d-b68b-49d6-b734-20d13d74e25d"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:21:30.563513 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-f1ef983a-5c92-4913-8d02-898b78202dd2 req-92d55fdd-5353-48ee-a939-61341d0eb6b5 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:30.564220 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-f1ef983a-5c92-4913-8d02-898b78202dd2 req-92d55fdd-5353-48ee-a939-61341d0eb6b5 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:30.576228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-f1ef983a-5c92-4913-8d02-898b78202dd2 req-92d55fdd-5353-48ee-a939-61341d0eb6b5 service nova] Creating event network-vif-deleted:f0229d6d-b68b-49d6-b734-20d13d74e25d for instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d on hv-cinder-74216 Jul 04 04:21:30.581316 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-f1ef983a-5c92-4913-8d02-898b78202dd2 req-92d55fdd-5353-48ee-a939-61341d0eb6b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032135 Jul 04 04:21:30.582012 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 358/730] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:21:31.129952 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-375bc7ca-ec1c-4d44-ac02-15e85eb2426c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:31.130694 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-375bc7ca-ec1c-4d44-ac02-15e85eb2426c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:31.137457 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-375bc7ca-ec1c-4d44-ac02-15e85eb2426c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:31.137978 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-375bc7ca-ec1c-4d44-ac02-15e85eb2426c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:31.138886 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-375bc7ca-ec1c-4d44-ac02-15e85eb2426c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:31.139422 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-375bc7ca-ec1c-4d44-ac02-15e85eb2426c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:31.166680 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-375bc7ca-ec1c-4d44-ac02-15e85eb2426c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Going to try to terminate instance {{(pid=117875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:21:31.257227 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-375bc7ca-ec1c-4d44-ac02-15e85eb2426c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "DELETE /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 204 len: 0 microversion: 2.1 time: 0.130770 Jul 04 04:21:31.258135 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 373/731] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:21:31 2022] DELETE /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:21:31.267277 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d374887c-acd5-459f-937f-0162d75ee726 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:31.267969 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d374887c-acd5-459f-937f-0162d75ee726 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:31.274639 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d374887c-acd5-459f-937f-0162d75ee726 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:31.275092 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d374887c-acd5-459f-937f-0162d75ee726 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:31.275867 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d374887c-acd5-459f-937f-0162d75ee726 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:31.276299 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d374887c-acd5-459f-937f-0162d75ee726 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:31.383121 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-db100e25-5b82-4cc7-b3c3-fe97f7bfe6f9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:31.384291 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-db100e25-5b82-4cc7-b3c3-fe97f7bfe6f9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:31.392935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db100e25-5b82-4cc7-b3c3-fe97f7bfe6f9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:31.394263 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db100e25-5b82-4cc7-b3c3-fe97f7bfe6f9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:31.395090 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db100e25-5b82-4cc7-b3c3-fe97f7bfe6f9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:31.395519 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db100e25-5b82-4cc7-b3c3-fe97f7bfe6f9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:31.415589 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d374887c-acd5-459f-937f-0162d75ee726 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:31.423591 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d374887c-acd5-459f-937f-0162d75ee726 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1509 microversion: 2.1 time: 0.160706 Jul 04 04:21:31.424409 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 359/732] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:31 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:31.429986 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db100e25-5b82-4cc7-b3c3-fe97f7bfe6f9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:31.430457 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db100e25-5b82-4cc7-b3c3-fe97f7bfe6f9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:31.430985 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.objects.instance [None req-db100e25-5b82-4cc7-b3c3-fe97f7bfe6f9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lazy-loading 'fault' on Instance uuid bc36b6d5-12c0-48bd-9aee-afdef9e38c2d {{(pid=117875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:21:31.481520 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-db100e25-5b82-4cc7-b3c3-fe97f7bfe6f9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:31.490089 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-db100e25-5b82-4cc7-b3c3-fe97f7bfe6f9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 200 len: 1230 microversion: 2.1 time: 0.111447 Jul 04 04:21:31.490765 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 374/733] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:31 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 1230 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:31.689780 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-64fe22c6-7da1-4dfb-9ab3-9386f0ba64c4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:31.690308 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-64fe22c6-7da1-4dfb-9ab3-9386f0ba64c4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:31.697306 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64fe22c6-7da1-4dfb-9ab3-9386f0ba64c4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:31.697755 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64fe22c6-7da1-4dfb-9ab3-9386f0ba64c4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:31.698558 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64fe22c6-7da1-4dfb-9ab3-9386f0ba64c4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:31.698989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-64fe22c6-7da1-4dfb-9ab3-9386f0ba64c4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:31.727806 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-64fe22c6-7da1-4dfb-9ab3-9386f0ba64c4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/os-volume_attachments/c09cea1d-7f6d-4be4-8c73-dec8b6964fd8" status: 200 len: 194 microversion: 2.20 time: 0.042228 Jul 04 04:21:31.728370 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 360/734] 10.222.0.16 () {60 vars in 1453 bytes} [Mon Jul 4 04:21:31 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/os-volume_attachments/c09cea1d-7f6d-4be4-8c73-dec8b6964fd8 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:21:31.794954 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-27b8c3be-5119-40d6-a584-46ebf408ac03 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:31.795649 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-27b8c3be-5119-40d6-a584-46ebf408ac03 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:31.805229 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-27b8c3be-5119-40d6-a584-46ebf408ac03 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:31.805685 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-27b8c3be-5119-40d6-a584-46ebf408ac03 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:31.806492 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-27b8c3be-5119-40d6-a584-46ebf408ac03 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:31.806893 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-27b8c3be-5119-40d6-a584-46ebf408ac03 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:31.896809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.objects.instance [None req-27b8c3be-5119-40d6-a584-46ebf408ac03 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lazy-loading 'services' on Instance uuid c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 {{(pid=117875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:21:31.982261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-27b8c3be-5119-40d6-a584-46ebf408ac03 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/os-volume_attachments/c09cea1d-7f6d-4be4-8c73-dec8b6964fd8" status: 202 len: 0 microversion: 2.20 time: 0.192060 Jul 04 04:21:31.982897 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 375/735] 10.222.0.16 () {60 vars in 1456 bytes} [Mon Jul 4 04:21:31 2022] DELETE /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/os-volume_attachments/c09cea1d-7f6d-4be4-8c73-dec8b6964fd8 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:21:31.991583 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-391e3aa8-8a5a-47a5-91bc-96e110974a12 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:31.992510 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-391e3aa8-8a5a-47a5-91bc-96e110974a12 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:31.998555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-391e3aa8-8a5a-47a5-91bc-96e110974a12 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:31.999001 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-391e3aa8-8a5a-47a5-91bc-96e110974a12 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:31.999756 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-391e3aa8-8a5a-47a5-91bc-96e110974a12 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:32.000189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-391e3aa8-8a5a-47a5-91bc-96e110974a12 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:32.029634 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-391e3aa8-8a5a-47a5-91bc-96e110974a12 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042222 Jul 04 04:21:32.030189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 361/736] 10.222.0.16 () {60 vars in 1342 bytes} [Mon Jul 4 04:21:31 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:21:32.442495 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-dca04d42-7b73-40d1-9acd-e4d467510e44 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:32.443199 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-dca04d42-7b73-40d1-9acd-e4d467510e44 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:32.449710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dca04d42-7b73-40d1-9acd-e4d467510e44 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:32.450235 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dca04d42-7b73-40d1-9acd-e4d467510e44 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:32.451099 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dca04d42-7b73-40d1-9acd-e4d467510e44 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:32.451598 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dca04d42-7b73-40d1-9acd-e4d467510e44 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:32.507230 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2590f2bc-7028-4246-9ed8-af17b84b4868 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:32.508665 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2590f2bc-7028-4246-9ed8-af17b84b4868 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:32.516157 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2590f2bc-7028-4246-9ed8-af17b84b4868 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:32.516590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2590f2bc-7028-4246-9ed8-af17b84b4868 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:32.517352 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2590f2bc-7028-4246-9ed8-af17b84b4868 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:32.517756 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2590f2bc-7028-4246-9ed8-af17b84b4868 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:32.534962 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-2590f2bc-7028-4246-9ed8-af17b84b4868 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] HTTP exception thrown: Instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d could not be found. Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2590f2bc-7028-4246-9ed8-af17b84b4868 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Request method failure captured: Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d HTTP/1.1 Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmnxZ0QXBxE2O90vGpLD26PhoGwtTx6MB7Etczz8f1dMUcriFIVAyImIsWs46fp50rBtP1LUDkrXci_RbYSL8uCi081BiK3i334uDcLCBi1q2-3E6HomyJxGcv6D7S4lMMhGrMT1Fa_Z6kuJFOV8EZfolEkzW3RGWUucV_Hgi7cgfpY Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: b622ab692a73432784c63b9ad3290e72 Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-TestVolumeBootPattern-836926993 Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:21:32.536989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:21:32.538731 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b622ab692a73432784c63b9ad3290e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b622ab692a73432784c63b9ad3290e72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b622ab692a73432784c63b9ad3290e72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b622ab692a73432784c63b9ad3290e72", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:21:32.538731 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-TestVolumeBootPattern-836926993 Jul 04 04:21:32.538731 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: b622ab692a73432784c63b9ad3290e72 Jul 04 04:21:32.538731 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-TestVolumeBootPattern-836926993 Jul 04 04:21:32.538731 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-TestVolumeBootPattern-836926993-project Jul 04 04:21:32.538731 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:21:32.538731 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:21:32.538731 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: 34ec54486c9d404896f832b87f99bc11 Jul 04 04:21:32.538731 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-TestVolumeBootPattern-836926993-project Jul 04 04:21:32.538731 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:21:32.538731 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d could not be found. Jul 04 04:21:32.538731 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': 'bc36b6d5-12c0-48bd-9aee-afdef9e38c2d'} Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d could not be found. Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:21:32.539829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:21:32.541189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:21:32.541189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:21:32.541189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:21:32.541189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:21:32.541189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:21:32.541189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:21:32.541189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:21:32.541189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d could not be found. Jul 04 04:21:32.541189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:32.541189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:21:32.541189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:32.541189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:21:32.541189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:21:32.541189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:21:32.541189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:21:32.541189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:21:32.541189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d could not be found. Jul 04 04:21:32.541189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:32.543682 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2590f2bc-7028-4246-9ed8-af17b84b4868 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Returning 404 to user: Instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:21:32.545082 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2590f2bc-7028-4246-9ed8-af17b84b4868 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 404 len: 111 microversion: 2.1 time: 0.041795 Jul 04 04:21:32.545974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 362/737] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:32 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:21:32.630483 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-dca04d42-7b73-40d1-9acd-e4d467510e44 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:32.633606 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-390ffd9b-17c2-4596-8d65-d620fefb7db3 req-2a4af41b-2e3b-4c86-a908-3c019b0fa178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "314d0a92-11cc-45ac-b70b-1c65f66ecfc4", "name": "network-vif-deleted", "tag": "0de8d78e-8696-4840-bc1b-e94f52bb4eb1"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:21:32.642239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-dca04d42-7b73-40d1-9acd-e4d467510e44 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 200 len: 1509 microversion: 2.1 time: 0.204560 Jul 04 04:21:32.644038 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-390ffd9b-17c2-4596-8d65-d620fefb7db3 req-2a4af41b-2e3b-4c86-a908-3c019b0fa178 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:32.644484 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-390ffd9b-17c2-4596-8d65-d620fefb7db3 req-2a4af41b-2e3b-4c86-a908-3c019b0fa178 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:32.647318 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 376/738] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:32 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:32.658620 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-390ffd9b-17c2-4596-8d65-d620fefb7db3 req-2a4af41b-2e3b-4c86-a908-3c019b0fa178 service nova] Creating event network-vif-deleted:0de8d78e-8696-4840-bc1b-e94f52bb4eb1 for instance 314d0a92-11cc-45ac-b70b-1c65f66ecfc4 on hv-cinder-74216 Jul 04 04:21:32.664677 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-390ffd9b-17c2-4596-8d65-d620fefb7db3 req-2a4af41b-2e3b-4c86-a908-3c019b0fa178 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035448 Jul 04 04:21:32.668129 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 363/739] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:21:32.675340 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-62ff95d2-7b61-4313-8af9-ccab741c8eec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-171222016", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1321978684", "security_groups": [{"name": "tempest-secgroup-smoke-122465126"}], "block_device_mapping_v2": [{"uuid": "937b9b32-def2-45ed-8629-ac9a9cd5e3af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1d07c9ba-9977-4c1a-95be-b18ead1c7da1"}]}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:21:32.807764 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.network.neutron [None req-62ff95d2-7b61-4313-8af9-ccab741c8eec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] validate_networks() for [('1d07c9ba-9977-4c1a-95be-b18ead1c7da1', None, None, None, None, None)] {{(pid=117875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:21:33.044592 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c0a595f1-a648-48f7-92fa-c8e657a8d654 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:33.045608 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c0a595f1-a648-48f7-92fa-c8e657a8d654 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:33.052102 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c0a595f1-a648-48f7-92fa-c8e657a8d654 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:33.052535 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c0a595f1-a648-48f7-92fa-c8e657a8d654 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:33.053301 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c0a595f1-a648-48f7-92fa-c8e657a8d654 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:33.053743 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c0a595f1-a648-48f7-92fa-c8e657a8d654 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:33.088295 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c0a595f1-a648-48f7-92fa-c8e657a8d654 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048563 Jul 04 04:21:33.089461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 364/740] 10.222.0.16 () {60 vars in 1342 bytes} [Mon Jul 4 04:21:33 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 04:21:33.198327 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-62ff95d2-7b61-4313-8af9-ccab741c8eec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Flavor limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:21:33.198807 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-62ff95d2-7b61-4313-8af9-ccab741c8eec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Image limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:21:33.199277 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-62ff95d2-7b61-4313-8af9-ccab741c8eec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Flavor pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:21:33.199681 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-62ff95d2-7b61-4313-8af9-ccab741c8eec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Image pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:21:33.200103 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-62ff95d2-7b61-4313-8af9-ccab741c8eec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:21:33.210406 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-62ff95d2-7b61-4313-8af9-ccab741c8eec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:33.210968 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-62ff95d2-7b61-4313-8af9-ccab741c8eec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:33.211774 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-62ff95d2-7b61-4313-8af9-ccab741c8eec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:33.212204 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-62ff95d2-7b61-4313-8af9-ccab741c8eec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:33.230377 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-62ff95d2-7b61-4313-8af9-ccab741c8eec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Getting quotas for project b622ab692a73432784c63b9ad3290e72. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:21:33.234142 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-62ff95d2-7b61-4313-8af9-ccab741c8eec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Getting quotas for user 34ec54486c9d404896f832b87f99bc11 and project b622ab692a73432784c63b9ad3290e72. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:21:33.292311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-62ff95d2-7b61-4313-8af9-ccab741c8eec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Going to run 1 instances... {{(pid=117875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:21:33.294530 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-62ff95d2-7b61-4313-8af9-ccab741c8eec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='937b9b32-def2-45ed-8629-ac9a9cd5e3af',volume_size=None,volume_type=None)] {{(pid=117875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:21:33.436654 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-62ff95d2-7b61-4313-8af9-ccab741c8eec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.765170 Jul 04 04:21:33.437498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 377/741] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:21:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 04:21:33.448294 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2296700c-c77f-4b61-825c-bb9622e9f87d tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:33.448909 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2296700c-c77f-4b61-825c-bb9622e9f87d tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:33.505549 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2296700c-c77f-4b61-825c-bb9622e9f87d tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:33.514788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2296700c-c77f-4b61-825c-bb9622e9f87d tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1094 microversion: 2.1 time: 0.070590 Jul 04 04:21:33.515395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 365/742] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:33 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:33.659678 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9e7c26a0-05fc-491b-83d9-7e1c85433563 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:33.660258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-9e7c26a0-05fc-491b-83d9-7e1c85433563 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 314d0a92-11cc-45ac-b70b-1c65f66ecfc4] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:33.667478 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9e7c26a0-05fc-491b-83d9-7e1c85433563 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:33.667939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9e7c26a0-05fc-491b-83d9-7e1c85433563 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:33.668669 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9e7c26a0-05fc-491b-83d9-7e1c85433563 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:33.669090 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9e7c26a0-05fc-491b-83d9-7e1c85433563 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:33.673390 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:33.685510 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-9e7c26a0-05fc-491b-83d9-7e1c85433563 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] HTTP exception thrown: Instance 314d0a92-11cc-45ac-b70b-1c65f66ecfc4 could not be found. Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9e7c26a0-05fc-491b-83d9-7e1c85433563 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Request method failure captured: Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 HTTP/1.1 Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmktGFBnwxVIACZValM9F_vrhCgFSRvMfNRwtdrHKuyEsmF4aiq464pUWCHoMBUPvBNYcADpX-2vxT_KraK3ReDT4FVftgwsiJAXYCECV12XOYlbBVQ1ZYULfr056xZkZOy4W69n1sC16SqMpBplnzVOrH2eQH8bDSp-6KdyeIq-sHU Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: 7ea328a1154a4a9a955e411f7eab0aa9 Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1922475267 Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:21:33.687375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:21:33.689293 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ea328a1154a4a9a955e411f7eab0aa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ea328a1154a4a9a955e411f7eab0aa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ea328a1154a4a9a955e411f7eab0aa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ea328a1154a4a9a955e411f7eab0aa9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:21:33.689293 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1922475267 Jul 04 04:21:33.689293 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: 7ea328a1154a4a9a955e411f7eab0aa9 Jul 04 04:21:33.689293 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1922475267 Jul 04 04:21:33.689293 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-ServerRescueNegativeTestJSON-1922475267-project Jul 04 04:21:33.689293 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:21:33.689293 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:21:33.689293 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: dca54bc220104e79aa727f30399f3411 Jul 04 04:21:33.689293 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1922475267-project Jul 04 04:21:33.689293 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:21:33.689293 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance 314d0a92-11cc-45ac-b70b-1c65f66ecfc4 could not be found. Jul 04 04:21:33.689293 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': '314d0a92-11cc-45ac-b70b-1c65f66ecfc4'} Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 314d0a92-11cc-45ac-b70b-1c65f66ecfc4 could not be found. Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:21:33.690206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:21:33.691855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:21:33.691855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:21:33.691855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:21:33.691855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:21:33.691855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:21:33.691855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:21:33.691855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:21:33.691855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 314d0a92-11cc-45ac-b70b-1c65f66ecfc4 could not be found. Jul 04 04:21:33.691855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:21:33.691855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:21:33.691855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:21:33.691855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:21:33.691855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:21:33.691855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:21:33.691855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:21:33.691855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:21:33.691855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 314d0a92-11cc-45ac-b70b-1c65f66ecfc4 could not be found. Jul 04 04:21:33.691855 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:21:33.693585 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9e7c26a0-05fc-491b-83d9-7e1c85433563 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Returning 404 to user: Instance 314d0a92-11cc-45ac-b70b-1c65f66ecfc4 could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:21:33.693585 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9e7c26a0-05fc-491b-83d9-7e1c85433563 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4" status: 404 len: 111 microversion: 2.1 time: 0.033762 Jul 04 04:21:33.693585 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 378/743] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:33 2022] GET /compute/v2.1/servers/314d0a92-11cc-45ac-b70b-1c65f66ecfc4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:21:33.698843 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1af227cf-798d-4c40-abb4-c8b0d86da231 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:33.706144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1af227cf-798d-4c40-abb4-c8b0d86da231 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:33.713436 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1af227cf-798d-4c40-abb4-c8b0d86da231 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:33.715175 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1af227cf-798d-4c40-abb4-c8b0d86da231 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:33.716154 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1af227cf-798d-4c40-abb4-c8b0d86da231 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:33.716761 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1af227cf-798d-4c40-abb4-c8b0d86da231 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:33.747709 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1af227cf-798d-4c40-abb4-c8b0d86da231 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:21:33.829044 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1af227cf-798d-4c40-abb4-c8b0d86da231 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 204 len: 0 microversion: 2.1 time: 0.133964 Jul 04 04:21:33.830074 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 366/744] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:21:33 2022] DELETE /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:21:33.839977 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-06f6346e-52e6-4c46-9087-f0600e57ede5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:33.840709 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-06f6346e-52e6-4c46-9087-f0600e57ede5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:33.848636 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-06f6346e-52e6-4c46-9087-f0600e57ede5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:33.849066 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-06f6346e-52e6-4c46-9087-f0600e57ede5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:33.849842 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-06f6346e-52e6-4c46-9087-f0600e57ede5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:33.850276 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-06f6346e-52e6-4c46-9087-f0600e57ede5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:33.983981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-06f6346e-52e6-4c46-9087-f0600e57ede5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:33.991772 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-06f6346e-52e6-4c46-9087-f0600e57ede5 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.157034 Jul 04 04:21:33.992334 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 379/745] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:33 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:34.100798 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-30e1aaa3-0681-4c1c-8d0f-e2a3826fbf06 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:34.101889 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-30e1aaa3-0681-4c1c-8d0f-e2a3826fbf06 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:34.109366 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30e1aaa3-0681-4c1c-8d0f-e2a3826fbf06 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:34.109819 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30e1aaa3-0681-4c1c-8d0f-e2a3826fbf06 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:34.110629 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30e1aaa3-0681-4c1c-8d0f-e2a3826fbf06 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:34.111069 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30e1aaa3-0681-4c1c-8d0f-e2a3826fbf06 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:34.142609 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-30e1aaa3-0681-4c1c-8d0f-e2a3826fbf06 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046451 Jul 04 04:21:34.143182 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 367/746] 10.222.0.16 () {60 vars in 1342 bytes} [Mon Jul 4 04:21:34 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:34.205710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-105c98a4-a6bf-4c53-a39e-d5fe07455c76 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:34.206391 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-105c98a4-a6bf-4c53-a39e-d5fe07455c76 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:34.215593 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-105c98a4-a6bf-4c53-a39e-d5fe07455c76 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:34.216327 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-105c98a4-a6bf-4c53-a39e-d5fe07455c76 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:34.217500 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-105c98a4-a6bf-4c53-a39e-d5fe07455c76 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:34.218224 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-105c98a4-a6bf-4c53-a39e-d5fe07455c76 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:34.250643 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-105c98a4-a6bf-4c53-a39e-d5fe07455c76 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Going to try to terminate instance {{(pid=117875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:21:34.346176 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-105c98a4-a6bf-4c53-a39e-d5fe07455c76 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 204 len: 0 microversion: 2.20 time: 0.146286 Jul 04 04:21:34.346712 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 380/747] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Jul 4 04:21:34 2022] DELETE /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 04 04:21:34.356278 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c83868e5-c2be-49ab-8da2-d1345f8346dc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:34.356920 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c83868e5-c2be-49ab-8da2-d1345f8346dc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:34.362899 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c83868e5-c2be-49ab-8da2-d1345f8346dc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:34.363342 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c83868e5-c2be-49ab-8da2-d1345f8346dc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:34.364104 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c83868e5-c2be-49ab-8da2-d1345f8346dc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:34.364534 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c83868e5-c2be-49ab-8da2-d1345f8346dc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:34.367375 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:34.508701 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c83868e5-c2be-49ab-8da2-d1345f8346dc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:34.517356 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c83868e5-c2be-49ab-8da2-d1345f8346dc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:34.518880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c83868e5-c2be-49ab-8da2-d1345f8346dc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:34.520061 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c83868e5-c2be-49ab-8da2-d1345f8346dc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1722 microversion: 2.20 time: 0.167755 Jul 04 04:21:34.520608 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 368/748] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:21:34 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:21:34.532610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-bd5bb359-0549-456c-8f30-d722f929c9fd tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:34.533295 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-bd5bb359-0549-456c-8f30-d722f929c9fd tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:34.540040 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bd5bb359-0549-456c-8f30-d722f929c9fd tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:34.540453 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bd5bb359-0549-456c-8f30-d722f929c9fd tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:34.541242 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bd5bb359-0549-456c-8f30-d722f929c9fd tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:34.541674 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bd5bb359-0549-456c-8f30-d722f929c9fd tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:34.611628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-bd5bb359-0549-456c-8f30-d722f929c9fd tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:34.619639 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-bd5bb359-0549-456c-8f30-d722f929c9fd tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1144 microversion: 2.1 time: 0.091297 Jul 04 04:21:34.620202 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 381/749] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:34 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:35.013846 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3b9bebd3-fce9-425c-87bf-3f6870099a25 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:35.014887 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3b9bebd3-fce9-425c-87bf-3f6870099a25 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:35.025732 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b9bebd3-fce9-425c-87bf-3f6870099a25 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:35.026566 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b9bebd3-fce9-425c-87bf-3f6870099a25 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:35.027844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b9bebd3-fce9-425c-87bf-3f6870099a25 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:35.028564 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b9bebd3-fce9-425c-87bf-3f6870099a25 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:35.169123 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3b9bebd3-fce9-425c-87bf-3f6870099a25 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:35.180527 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3b9bebd3-fce9-425c-87bf-3f6870099a25 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.173628 Jul 04 04:21:35.181270 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 369/750] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:35 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:35.539242 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d94b563f-1c0e-42a3-a4ef-82366ff38eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:35.539810 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d94b563f-1c0e-42a3-a4ef-82366ff38eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:35.546885 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d94b563f-1c0e-42a3-a4ef-82366ff38eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:35.547333 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d94b563f-1c0e-42a3-a4ef-82366ff38eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:35.548093 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d94b563f-1c0e-42a3-a4ef-82366ff38eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:35.548519 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d94b563f-1c0e-42a3-a4ef-82366ff38eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:35.638241 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-47f5c6ee-048a-414f-a32b-08963500b257 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:35.638869 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-47f5c6ee-048a-414f-a32b-08963500b257 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:35.645534 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47f5c6ee-048a-414f-a32b-08963500b257 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:35.645977 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47f5c6ee-048a-414f-a32b-08963500b257 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:35.646773 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47f5c6ee-048a-414f-a32b-08963500b257 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:35.647202 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47f5c6ee-048a-414f-a32b-08963500b257 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:35.680011 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d94b563f-1c0e-42a3-a4ef-82366ff38eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:35.688929 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d94b563f-1c0e-42a3-a4ef-82366ff38eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:35.690396 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d94b563f-1c0e-42a3-a4ef-82366ff38eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:35.691589 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d94b563f-1c0e-42a3-a4ef-82366ff38eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1722 microversion: 2.20 time: 0.156450 Jul 04 04:21:35.692806 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 382/751] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:21:35 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:21:35.714147 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-47f5c6ee-048a-414f-a32b-08963500b257 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:35.722131 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-47f5c6ee-048a-414f-a32b-08963500b257 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1144 microversion: 2.1 time: 0.088046 Jul 04 04:21:35.722811 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 370/752] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:35 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:36.202845 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-4fd13a33-3052-4e26-9ffc-e022fab105bf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:36.203448 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-4fd13a33-3052-4e26-9ffc-e022fab105bf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:36.209496 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4fd13a33-3052-4e26-9ffc-e022fab105bf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:36.209944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4fd13a33-3052-4e26-9ffc-e022fab105bf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:36.210724 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4fd13a33-3052-4e26-9ffc-e022fab105bf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:36.211146 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4fd13a33-3052-4e26-9ffc-e022fab105bf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:36.339540 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-4fd13a33-3052-4e26-9ffc-e022fab105bf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:36.347967 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-4fd13a33-3052-4e26-9ffc-e022fab105bf tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.149128 Jul 04 04:21:36.348505 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 383/753] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:36 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:36.715784 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ccfc0572-897c-4eff-aa8e-5eb4cabf1171 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:36.716487 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ccfc0572-897c-4eff-aa8e-5eb4cabf1171 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:36.723838 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ccfc0572-897c-4eff-aa8e-5eb4cabf1171 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:36.724287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ccfc0572-897c-4eff-aa8e-5eb4cabf1171 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:36.725047 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ccfc0572-897c-4eff-aa8e-5eb4cabf1171 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:36.725478 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ccfc0572-897c-4eff-aa8e-5eb4cabf1171 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:36.739473 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-97b0b392-6348-430b-adeb-39d29ae7bf9b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:36.740045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-97b0b392-6348-430b-adeb-39d29ae7bf9b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:36.747371 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-97b0b392-6348-430b-adeb-39d29ae7bf9b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:36.747810 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-97b0b392-6348-430b-adeb-39d29ae7bf9b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:36.748574 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-97b0b392-6348-430b-adeb-39d29ae7bf9b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:36.749000 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-97b0b392-6348-430b-adeb-39d29ae7bf9b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:36.813727 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-97b0b392-6348-430b-adeb-39d29ae7bf9b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:36.821378 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-97b0b392-6348-430b-adeb-39d29ae7bf9b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1136 microversion: 2.1 time: 0.085815 Jul 04 04:21:36.821950 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 384/754] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:36 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1136 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:36.857224 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ccfc0572-897c-4eff-aa8e-5eb4cabf1171 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:36.865076 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ccfc0572-897c-4eff-aa8e-5eb4cabf1171 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:36.866580 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ccfc0572-897c-4eff-aa8e-5eb4cabf1171 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:36.867729 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ccfc0572-897c-4eff-aa8e-5eb4cabf1171 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1722 microversion: 2.20 time: 0.159317 Jul 04 04:21:36.868296 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 371/755] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:21:36 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:21:37.366000 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-beb7940d-b037-436d-a06b-3940ed51870c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:37.366658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-beb7940d-b037-436d-a06b-3940ed51870c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:37.373239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-beb7940d-b037-436d-a06b-3940ed51870c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:37.373766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-beb7940d-b037-436d-a06b-3940ed51870c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:37.374580 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-beb7940d-b037-436d-a06b-3940ed51870c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:37.375016 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-beb7940d-b037-436d-a06b-3940ed51870c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:37.516236 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-beb7940d-b037-436d-a06b-3940ed51870c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:37.523840 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-beb7940d-b037-436d-a06b-3940ed51870c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1521 microversion: 2.1 time: 0.161881 Jul 04 04:21:37.524390 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 385/756] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:37 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:37.841004 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c274a2ed-c742-48f1-9501-92de2162d67e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:37.841630 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c274a2ed-c742-48f1-9501-92de2162d67e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:37.851621 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c274a2ed-c742-48f1-9501-92de2162d67e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:37.852341 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c274a2ed-c742-48f1-9501-92de2162d67e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:37.853581 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c274a2ed-c742-48f1-9501-92de2162d67e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:37.854201 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c274a2ed-c742-48f1-9501-92de2162d67e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:37.886638 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e4c184ad-0f50-4bc6-9693-5f02f0d57245 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:37.888260 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e4c184ad-0f50-4bc6-9693-5f02f0d57245 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:37.895471 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4c184ad-0f50-4bc6-9693-5f02f0d57245 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:37.895912 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4c184ad-0f50-4bc6-9693-5f02f0d57245 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:37.896686 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4c184ad-0f50-4bc6-9693-5f02f0d57245 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:37.897119 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e4c184ad-0f50-4bc6-9693-5f02f0d57245 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:37.964787 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c274a2ed-c742-48f1-9501-92de2162d67e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:37.974247 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c274a2ed-c742-48f1-9501-92de2162d67e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1192 microversion: 2.1 time: 0.137802 Jul 04 04:21:37.974898 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 372/757] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:37 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1192 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:38.138157 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e4c184ad-0f50-4bc6-9693-5f02f0d57245 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:38.156749 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e4c184ad-0f50-4bc6-9693-5f02f0d57245 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:38.158520 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e4c184ad-0f50-4bc6-9693-5f02f0d57245 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:38.160544 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e4c184ad-0f50-4bc6-9693-5f02f0d57245 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1722 microversion: 2.20 time: 0.277151 Jul 04 04:21:38.161310 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 386/758] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:21:37 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:21:38.546197 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4cb5e976-d949-46ed-b11e-2ddb71d8a475 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:38.547234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4cb5e976-d949-46ed-b11e-2ddb71d8a475 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:38.551551 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:38.560916 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cb5e976-d949-46ed-b11e-2ddb71d8a475 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:38.564921 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cb5e976-d949-46ed-b11e-2ddb71d8a475 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:38.565920 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cb5e976-d949-46ed-b11e-2ddb71d8a475 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:38.566358 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cb5e976-d949-46ed-b11e-2ddb71d8a475 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:38.595417 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-24cfc800-9c00-4744-8d74-bbff8cc3c13e req-7e32aa22-25a3-4f30-851e-b6ffe385ef6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e519dd6-a044-4afa-ac1b-bf1f53611738", "name": "network-vif-deleted", "tag": "3384abec-b08a-4477-8514-51d16c8ee80f"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:21:38.609746 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-24cfc800-9c00-4744-8d74-bbff8cc3c13e req-7e32aa22-25a3-4f30-851e-b6ffe385ef6e service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:38.612772 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-24cfc800-9c00-4744-8d74-bbff8cc3c13e req-7e32aa22-25a3-4f30-851e-b6ffe385ef6e service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:38.650981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-24cfc800-9c00-4744-8d74-bbff8cc3c13e req-7e32aa22-25a3-4f30-851e-b6ffe385ef6e service nova] Creating event network-vif-deleted:3384abec-b08a-4477-8514-51d16c8ee80f for instance 6e519dd6-a044-4afa-ac1b-bf1f53611738 on hv-cinder-74216 Jul 04 04:21:38.660580 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-24cfc800-9c00-4744-8d74-bbff8cc3c13e req-7e32aa22-25a3-4f30-851e-b6ffe385ef6e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068712 Jul 04 04:21:38.661490 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 387/759] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:21:38.727787 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4cb5e976-d949-46ed-b11e-2ddb71d8a475 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca54bc220104e79aa727f30399f3411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea328a1154a4a9a955e411f7eab0aa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:38.741540 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4cb5e976-d949-46ed-b11e-2ddb71d8a475 tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 200 len: 1479 microversion: 2.1 time: 0.199996 Jul 04 04:21:38.744084 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 373/760] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:38 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 1479 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:38.992533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-2735b501-cd47-43a9-a31e-21129f7f8469 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:38.993988 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-2735b501-cd47-43a9-a31e-21129f7f8469 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:39.001231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2735b501-cd47-43a9-a31e-21129f7f8469 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:39.001672 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2735b501-cd47-43a9-a31e-21129f7f8469 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:39.002460 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2735b501-cd47-43a9-a31e-21129f7f8469 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:39.002908 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2735b501-cd47-43a9-a31e-21129f7f8469 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:39.095532 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-2735b501-cd47-43a9-a31e-21129f7f8469 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:39.109276 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-2735b501-cd47-43a9-a31e-21129f7f8469 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1210 microversion: 2.1 time: 0.121900 Jul 04 04:21:39.110621 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-008d986b-0b1a-4023-bd17-4fd502419050 req-060008bf-daa6-4100-a2c8-b21e2639c78d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e151ec-4f75-4bfe-8c27-3d6ac7c72453", "name": "network-vif-deleted", "tag": "72e623a1-47a8-4ba4-ae5c-a1c4eb8869fc"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:21:39.120035 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 388/761] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:38 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1210 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:39.152024 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-008d986b-0b1a-4023-bd17-4fd502419050 req-060008bf-daa6-4100-a2c8-b21e2639c78d service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:39.157855 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-008d986b-0b1a-4023-bd17-4fd502419050 req-060008bf-daa6-4100-a2c8-b21e2639c78d service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:39.186606 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e41b35c4-63c3-412e-89c6-e578830baffc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:39.188391 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e41b35c4-63c3-412e-89c6-e578830baffc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:39.201233 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e41b35c4-63c3-412e-89c6-e578830baffc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:39.202122 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e41b35c4-63c3-412e-89c6-e578830baffc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:39.203395 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e41b35c4-63c3-412e-89c6-e578830baffc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:39.204045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e41b35c4-63c3-412e-89c6-e578830baffc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:39.214052 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-008d986b-0b1a-4023-bd17-4fd502419050 req-060008bf-daa6-4100-a2c8-b21e2639c78d service nova] Creating event network-vif-deleted:72e623a1-47a8-4ba4-ae5c-a1c4eb8869fc for instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 on hv-cinder-74216 Jul 04 04:21:39.229506 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-008d986b-0b1a-4023-bd17-4fd502419050 req-060008bf-daa6-4100-a2c8-b21e2639c78d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136436 Jul 04 04:21:39.230743 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 374/762] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:21:39.318469 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e41b35c4-63c3-412e-89c6-e578830baffc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:39.329498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e41b35c4-63c3-412e-89c6-e578830baffc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:39.331409 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e41b35c4-63c3-412e-89c6-e578830baffc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:39.332762 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e41b35c4-63c3-412e-89c6-e578830baffc tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 200 len: 1365 microversion: 2.20 time: 0.156585 Jul 04 04:21:39.333493 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 389/763] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:21:39 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 04:21:39.761514 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3d57c945-6c1c-4f5e-8090-c1721fdfe30c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:39.763121 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3d57c945-6c1c-4f5e-8090-c1721fdfe30c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] [instance: 6e519dd6-a044-4afa-ac1b-bf1f53611738] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:39.771883 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d57c945-6c1c-4f5e-8090-c1721fdfe30c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:39.772306 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d57c945-6c1c-4f5e-8090-c1721fdfe30c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:39.774066 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d57c945-6c1c-4f5e-8090-c1721fdfe30c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:39.774545 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d57c945-6c1c-4f5e-8090-c1721fdfe30c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:39.789897 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-3d57c945-6c1c-4f5e-8090-c1721fdfe30c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] HTTP exception thrown: Instance 6e519dd6-a044-4afa-ac1b-bf1f53611738 could not be found. Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3d57c945-6c1c-4f5e-8090-c1721fdfe30c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Request method failure captured: Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 HTTP/1.1 Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmktGFBnwxVIACZValM9F_vrhCgFSRvMfNRwtdrHKuyEsmF4aiq464pUWCHoMBUPvBNYcADpX-2vxT_KraK3ReDT4FVftgwsiJAXYCECV12XOYlbBVQ1ZYULfr056xZkZOy4W69n1sC16SqMpBplnzVOrH2eQH8bDSp-6KdyeIq-sHU Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 7ea328a1154a4a9a955e411f7eab0aa9 Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1922475267 Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:21:39.791645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:21:39.794077 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ea328a1154a4a9a955e411f7eab0aa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ea328a1154a4a9a955e411f7eab0aa9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ea328a1154a4a9a955e411f7eab0aa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ea328a1154a4a9a955e411f7eab0aa9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:21:39.794077 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1922475267 Jul 04 04:21:39.794077 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 7ea328a1154a4a9a955e411f7eab0aa9 Jul 04 04:21:39.794077 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1922475267 Jul 04 04:21:39.794077 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-ServerRescueNegativeTestJSON-1922475267-project Jul 04 04:21:39.794077 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:21:39.794077 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:21:39.794077 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: dca54bc220104e79aa727f30399f3411 Jul 04 04:21:39.794077 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1922475267-project Jul 04 04:21:39.794077 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:21:39.794077 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance 6e519dd6-a044-4afa-ac1b-bf1f53611738 could not be found. Jul 04 04:21:39.794077 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': '6e519dd6-a044-4afa-ac1b-bf1f53611738'} Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e519dd6-a044-4afa-ac1b-bf1f53611738 could not be found. Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:21:39.795039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:21:39.796555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:21:39.796555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:21:39.796555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:21:39.796555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:21:39.796555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:21:39.796555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:21:39.796555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:21:39.796555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e519dd6-a044-4afa-ac1b-bf1f53611738 could not be found. Jul 04 04:21:39.796555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:39.796555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:21:39.796555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:39.796555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:21:39.796555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:21:39.796555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:21:39.796555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:21:39.796555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:21:39.796555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e519dd6-a044-4afa-ac1b-bf1f53611738 could not be found. Jul 04 04:21:39.796555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:39.797916 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3d57c945-6c1c-4f5e-8090-c1721fdfe30c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] Returning 404 to user: Instance 6e519dd6-a044-4afa-ac1b-bf1f53611738 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:21:39.797916 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3d57c945-6c1c-4f5e-8090-c1721fdfe30c tempest-ServerRescueNegativeTestJSON-1922475267 tempest-ServerRescueNegativeTestJSON-1922475267-project] 10.222.0.16 "GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738" status: 404 len: 111 microversion: 2.1 time: 0.037694 Jul 04 04:21:39.797916 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 375/764] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:39 2022] GET /compute/v2.1/servers/6e519dd6-a044-4afa-ac1b-bf1f53611738 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:21:40.126768 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a2ce044e-feac-493f-b411-733199f36525 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:40.127547 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a2ce044e-feac-493f-b411-733199f36525 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:40.134435 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a2ce044e-feac-493f-b411-733199f36525 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:40.135609 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a2ce044e-feac-493f-b411-733199f36525 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:40.136989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a2ce044e-feac-493f-b411-733199f36525 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:40.137651 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a2ce044e-feac-493f-b411-733199f36525 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:40.356807 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1d2344ad-3992-4369-9849-f8f51740a10a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:40.358423 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1d2344ad-3992-4369-9849-f8f51740a10a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:40.366091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d2344ad-3992-4369-9849-f8f51740a10a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:40.366609 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d2344ad-3992-4369-9849-f8f51740a10a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:40.367519 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d2344ad-3992-4369-9849-f8f51740a10a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:40.367957 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d2344ad-3992-4369-9849-f8f51740a10a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:40.390531 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-1d2344ad-3992-4369-9849-f8f51740a10a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] HTTP exception thrown: Instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 could not be found. Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1d2344ad-3992-4369-9849-f8f51740a10a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Request method failure captured: Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 HTTP/1.1 Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmnArG0gFq-Mhp0LfDDk7PvWs0b-E4X7JpMTm6wY2R8S_kcEYz19NDkLFuif9LYPPYIiEgr2zN2Gac_0iF1l7ppB9yWX4IRGfCpcokDIw_hpibe7DDNOnDsMzVq75O9vXj5QVB_Z0ILJrBraJqKwg05FWQWFRKG-u--0b0-nmb2spUU Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 77e83a80c1b34e67958aca6d0a10ba8a Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-687534770 Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:21:40.395906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:21:40.397600 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77e83a80c1b34e67958aca6d0a10ba8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/77e83a80c1b34e67958aca6d0a10ba8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77e83a80c1b34e67958aca6d0a10ba8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_77e83a80c1b34e67958aca6d0a10ba8a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:21:40.397600 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-687534770 Jul 04 04:21:40.397600 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 77e83a80c1b34e67958aca6d0a10ba8a Jul 04 04:21:40.397600 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-687534770 Jul 04 04:21:40.397600 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeShelveTestJSON-687534770-project Jul 04 04:21:40.397600 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:21:40.397600 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:21:40.397600 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: e43d573fcf384f65b7382f2d0a01ade4 Jul 04 04:21:40.397600 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-687534770-project Jul 04 04:21:40.397600 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:21:40.397600 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 could not be found. Jul 04 04:21:40.397600 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': 'c6e151ec-4f75-4bfe-8c27-3d6ac7c72453'} Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 could not be found. Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:21:40.398572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:21:40.399990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:21:40.399990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:21:40.399990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:21:40.399990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:21:40.399990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:21:40.399990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:21:40.399990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:21:40.399990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 could not be found. Jul 04 04:21:40.399990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:40.399990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:21:40.399990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:40.399990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:21:40.399990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:21:40.399990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:21:40.399990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:21:40.399990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:21:40.399990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 could not be found. Jul 04 04:21:40.399990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:21:40.404227 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1d2344ad-3992-4369-9849-f8f51740a10a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Returning 404 to user: Instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:21:40.405332 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1d2344ad-3992-4369-9849-f8f51740a10a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 404 len: 111 microversion: 2.20 time: 0.057186 Jul 04 04:21:40.407257 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 376/765] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:21:40 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 04:21:40.422809 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fdce82c0-b2de-44d4-8d44-a81dde258fc8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '.version_select at 0x7f50c1013790>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:40.452441 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fdce82c0-b2de-44d4-8d44-a81dde258fc8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-733379013" status: 204 len: 0 microversion: 2.20 time: 0.040398 Jul 04 04:21:40.456102 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 377/766] 10.222.0.16 () {60 vars in 1258 bytes} [Mon Jul 4 04:21:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-733379013 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 04 04:21:40.643507 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a2ce044e-feac-493f-b411-733199f36525 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:40.654684 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a2ce044e-feac-493f-b411-733199f36525 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1265 microversion: 2.1 time: 0.531825 Jul 04 04:21:40.665439 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 390/767] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:40 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1265 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:21:40.692008 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-e2aaffb2-8d58-4691-8631-bf60af8dac86 req-764e21fd-8a52-42eb-9746-c0721a7236a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e07bec57-64a0-4669-9cb5-6d54d72b8f20", "tag": "2bb1a3cb-fe02-4fa0-814e-4fcbd93520ba"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:21:40.720162 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-e2aaffb2-8d58-4691-8631-bf60af8dac86 req-764e21fd-8a52-42eb-9746-c0721a7236a3 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:40.720748 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-e2aaffb2-8d58-4691-8631-bf60af8dac86 req-764e21fd-8a52-42eb-9746-c0721a7236a3 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:40.738604 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-e2aaffb2-8d58-4691-8631-bf60af8dac86 req-764e21fd-8a52-42eb-9746-c0721a7236a3 service nova] Creating event network-changed:2bb1a3cb-fe02-4fa0-814e-4fcbd93520ba for instance e07bec57-64a0-4669-9cb5-6d54d72b8f20 on hv-cinder-74216 Jul 04 04:21:40.751368 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-e2aaffb2-8d58-4691-8631-bf60af8dac86 req-764e21fd-8a52-42eb-9746-c0721a7236a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070252 Jul 04 04:21:40.753867 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 378/768] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:21:41.457374 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-62b4c620-a182-42b3-bc07-0b0436f85213 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Action: 'create', calling method: .version_select at 0x7f50c14505e0>, body: {"keypair": {"name": "tempest-keypair-1422019908", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQFQ3R04tY56a83Hyc+3wHTaRuTHzhHT/AyFAW/geY+HTXBqcq+p1pF26BTT/pP0vRBofy9JjfMUKxeeuXVYOSfmgu6NtrU9Of03ATnL2OpaXa+Q6Iw32Nxhw2PJ+YCKQ=="}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:21:41.462075 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:41.476287 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-62b4c620-a182-42b3-bc07-0b0436f85213 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Getting quotas for project 77e83a80c1b34e67958aca6d0a10ba8a. Resources: {'key_pairs'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:21:41.481761 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-62b4c620-a182-42b3-bc07-0b0436f85213 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Getting quotas for user e43d573fcf384f65b7382f2d0a01ade4 and project 77e83a80c1b34e67958aca6d0a10ba8a. Resources: {'key_pairs'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:21:41.506353 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-62b4c620-a182-42b3-bc07-0b0436f85213 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052865 Jul 04 04:21:41.507326 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 391/769] 10.222.0.16 () {62 vars in 1199 bytes} [Mon Jul 4 04:21:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 04 04:21:41.673892 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-796019e3-ee0c-4196-b81a-aa461216d740 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:41.675259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-796019e3-ee0c-4196-b81a-aa461216d740 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:41.683186 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-796019e3-ee0c-4196-b81a-aa461216d740 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:41.683752 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-796019e3-ee0c-4196-b81a-aa461216d740 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:41.684531 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-796019e3-ee0c-4196-b81a-aa461216d740 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:41.684963 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-796019e3-ee0c-4196-b81a-aa461216d740 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:41.872683 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-796019e3-ee0c-4196-b81a-aa461216d740 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:41.880496 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-796019e3-ee0c-4196-b81a-aa461216d740 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1265 microversion: 2.1 time: 0.210857 Jul 04 04:21:41.881070 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 379/770] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:41 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:42.899741 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-97c6c03a-77e5-4df5-8865-4119a0aee079 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:42.900328 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-97c6c03a-77e5-4df5-8865-4119a0aee079 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:42.909583 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-97c6c03a-77e5-4df5-8865-4119a0aee079 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:42.909953 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-97c6c03a-77e5-4df5-8865-4119a0aee079 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:42.910841 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-97c6c03a-77e5-4df5-8865-4119a0aee079 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:42.911699 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-97c6c03a-77e5-4df5-8865-4119a0aee079 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:43.092676 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-97c6c03a-77e5-4df5-8865-4119a0aee079 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:43.100878 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-97c6c03a-77e5-4df5-8865-4119a0aee079 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1265 microversion: 2.1 time: 0.206108 Jul 04 04:21:43.101741 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 392/771] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:42 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:21:44.118728 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7424a17e-be9d-45e4-8179-c2bac01c5109 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:44.119353 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7424a17e-be9d-45e4-8179-c2bac01c5109 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:44.122204 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:44.128705 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7424a17e-be9d-45e4-8179-c2bac01c5109 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:44.129186 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7424a17e-be9d-45e4-8179-c2bac01c5109 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:44.129985 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7424a17e-be9d-45e4-8179-c2bac01c5109 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:44.130466 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7424a17e-be9d-45e4-8179-c2bac01c5109 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:44.451465 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7424a17e-be9d-45e4-8179-c2bac01c5109 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:44.460158 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7424a17e-be9d-45e4-8179-c2bac01c5109 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1265 microversion: 2.1 time: 0.345568 Jul 04 04:21:44.461134 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 380/772] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:44 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1265 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:44.587116 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1387e9db-3f17-49e7-b8bb-087130f17fba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1811485686", "imageRef": "46b9937d-f997-401a-a3aa-bb9028764454", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4eec3fce-9c5d-44a0-be22-c0108d80e7d3"}], "security_groups": [{"name": "tempest-securitygroup--1163258072"}], "key_name": "tempest-keypair-1422019908", "user_data": "}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:21:44.595851 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=2 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:44.699319 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.network.neutron [None req-1387e9db-3f17-49e7-b8bb-087130f17fba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] validate_networks() for [('4eec3fce-9c5d-44a0-be22-c0108d80e7d3', None, None, None, None, None)] {{(pid=117875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:21:45.145441 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-1387e9db-3f17-49e7-b8bb-087130f17fba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Flavor limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:21:45.146742 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-1387e9db-3f17-49e7-b8bb-087130f17fba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Image limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:21:45.148533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-1387e9db-3f17-49e7-b8bb-087130f17fba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Flavor pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:21:45.149055 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-1387e9db-3f17-49e7-b8bb-087130f17fba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Image pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:21:45.151116 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-1387e9db-3f17-49e7-b8bb-087130f17fba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:21:45.167249 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1387e9db-3f17-49e7-b8bb-087130f17fba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:45.167947 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1387e9db-3f17-49e7-b8bb-087130f17fba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:45.168613 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1387e9db-3f17-49e7-b8bb-087130f17fba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:45.169041 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1387e9db-3f17-49e7-b8bb-087130f17fba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:45.189654 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-1387e9db-3f17-49e7-b8bb-087130f17fba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Getting quotas for project 77e83a80c1b34e67958aca6d0a10ba8a. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:21:45.193888 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-1387e9db-3f17-49e7-b8bb-087130f17fba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Getting quotas for user e43d573fcf384f65b7382f2d0a01ade4 and project 77e83a80c1b34e67958aca6d0a10ba8a. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:21:45.205402 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-1387e9db-3f17-49e7-b8bb-087130f17fba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Going to run 1 instances... {{(pid=117875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:21:45.207770 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-1387e9db-3f17-49e7-b8bb-087130f17fba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46b9937d-f997-401a-a3aa-bb9028764454',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:21:45.254326 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-1387e9db-3f17-49e7-b8bb-087130f17fba tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.671916 Jul 04 04:21:45.260328 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 393/773] 10.222.0.16 () {62 vars in 1187 bytes} [Mon Jul 4 04:21:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 04 04:21:45.266919 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a83097c0-a5d0-4ef3-9e77-5477a21b227c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:45.267589 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a83097c0-a5d0-4ef3-9e77-5477a21b227c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:45.337733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a83097c0-a5d0-4ef3-9e77-5477a21b227c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:45.349107 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a83097c0-a5d0-4ef3-9e77-5477a21b227c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:45.351794 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a83097c0-a5d0-4ef3-9e77-5477a21b227c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:45.353265 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a83097c0-a5d0-4ef3-9e77-5477a21b227c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1282 microversion: 2.20 time: 0.091564 Jul 04 04:21:45.355088 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 381/774] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:21:45 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1282 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:21:45.484895 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-26982dce-2b86-4e1b-ad73-909984d1b937 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:45.485455 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-26982dce-2b86-4e1b-ad73-909984d1b937 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:45.492477 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-26982dce-2b86-4e1b-ad73-909984d1b937 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:45.493104 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-26982dce-2b86-4e1b-ad73-909984d1b937 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:45.494080 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-26982dce-2b86-4e1b-ad73-909984d1b937 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:45.494708 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-26982dce-2b86-4e1b-ad73-909984d1b937 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:45.663328 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-26982dce-2b86-4e1b-ad73-909984d1b937 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:45.673201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-26982dce-2b86-4e1b-ad73-909984d1b937 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1265 microversion: 2.1 time: 0.192920 Jul 04 04:21:45.674087 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 394/775] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:45 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:46.373097 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c70ad802-9fff-48ee-8d8f-803ff6c18131 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:46.373712 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c70ad802-9fff-48ee-8d8f-803ff6c18131 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:46.381115 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c70ad802-9fff-48ee-8d8f-803ff6c18131 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:46.381845 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c70ad802-9fff-48ee-8d8f-803ff6c18131 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:46.382820 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c70ad802-9fff-48ee-8d8f-803ff6c18131 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:46.383623 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c70ad802-9fff-48ee-8d8f-803ff6c18131 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:46.493172 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c70ad802-9fff-48ee-8d8f-803ff6c18131 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:46.503735 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c70ad802-9fff-48ee-8d8f-803ff6c18131 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:46.505553 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c70ad802-9fff-48ee-8d8f-803ff6c18131 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:46.506910 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c70ad802-9fff-48ee-8d8f-803ff6c18131 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1342 microversion: 2.20 time: 0.138022 Jul 04 04:21:46.507755 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 382/776] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:21:46 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1342 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 04:21:46.692200 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1eb79146-5d45-4847-a41b-8cf9674a4ed8 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:46.692860 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-1eb79146-5d45-4847-a41b-8cf9674a4ed8 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:46.699491 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1eb79146-5d45-4847-a41b-8cf9674a4ed8 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:46.699945 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1eb79146-5d45-4847-a41b-8cf9674a4ed8 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:46.700765 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1eb79146-5d45-4847-a41b-8cf9674a4ed8 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:46.701200 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1eb79146-5d45-4847-a41b-8cf9674a4ed8 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:46.842789 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-1eb79146-5d45-4847-a41b-8cf9674a4ed8 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:46.850722 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-1eb79146-5d45-4847-a41b-8cf9674a4ed8 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1265 microversion: 2.1 time: 0.162536 Jul 04 04:21:46.851368 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 395/777] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:46 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:47.526699 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-156ff275-4a3d-461e-8715-22ccd2009766 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:47.527380 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-156ff275-4a3d-461e-8715-22ccd2009766 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:47.535034 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-156ff275-4a3d-461e-8715-22ccd2009766 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:47.535738 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-156ff275-4a3d-461e-8715-22ccd2009766 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:47.536627 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-156ff275-4a3d-461e-8715-22ccd2009766 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:47.537159 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-156ff275-4a3d-461e-8715-22ccd2009766 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:47.693516 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-156ff275-4a3d-461e-8715-22ccd2009766 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:47.702551 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-156ff275-4a3d-461e-8715-22ccd2009766 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:47.704228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-156ff275-4a3d-461e-8715-22ccd2009766 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:47.705584 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-156ff275-4a3d-461e-8715-22ccd2009766 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1408 microversion: 2.20 time: 0.183483 Jul 04 04:21:47.706579 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 383/778] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:21:47 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:21:47.868777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-8c6857fb-615f-462e-94a9-c38d4a0f3018 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:47.869527 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-8c6857fb-615f-462e-94a9-c38d4a0f3018 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:47.876603 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8c6857fb-615f-462e-94a9-c38d4a0f3018 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:47.877141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8c6857fb-615f-462e-94a9-c38d4a0f3018 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:47.878019 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8c6857fb-615f-462e-94a9-c38d4a0f3018 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:47.878523 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8c6857fb-615f-462e-94a9-c38d4a0f3018 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:47.882970 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:48.128181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-8c6857fb-615f-462e-94a9-c38d4a0f3018 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:48.137413 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-8c6857fb-615f-462e-94a9-c38d4a0f3018 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1265 microversion: 2.1 time: 0.271893 Jul 04 04:21:48.138320 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 396/779] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:47 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1265 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:48.726043 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-71dfbe0c-9f50-43ae-a21e-62aba2b35a3a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:48.726881 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-71dfbe0c-9f50-43ae-a21e-62aba2b35a3a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:48.739739 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71dfbe0c-9f50-43ae-a21e-62aba2b35a3a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:48.747148 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71dfbe0c-9f50-43ae-a21e-62aba2b35a3a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:48.748035 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71dfbe0c-9f50-43ae-a21e-62aba2b35a3a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:48.748491 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-71dfbe0c-9f50-43ae-a21e-62aba2b35a3a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:48.968831 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-80d8981a-2caf-488b-aa50-bbff6545ec71 req-41f78d87-78e9-4618-9cb0-2740f32ae325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb99d59a-d33a-48d2-9824-25f44c1f32c1", "tag": "f6b7b5f9-dfd8-4f10-99f9-c155d967e2de"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:21:48.990783 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-80d8981a-2caf-488b-aa50-bbff6545ec71 req-41f78d87-78e9-4618-9cb0-2740f32ae325 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:48.991228 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-80d8981a-2caf-488b-aa50-bbff6545ec71 req-41f78d87-78e9-4618-9cb0-2740f32ae325 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:49.027803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-80d8981a-2caf-488b-aa50-bbff6545ec71 req-41f78d87-78e9-4618-9cb0-2740f32ae325 service nova] Creating event network-changed:f6b7b5f9-dfd8-4f10-99f9-c155d967e2de for instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 on hv-cinder-74216 Jul 04 04:21:49.042767 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-80d8981a-2caf-488b-aa50-bbff6545ec71 req-41f78d87-78e9-4618-9cb0-2740f32ae325 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074342 Jul 04 04:21:49.044210 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 397/780] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:21:49.111048 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-71dfbe0c-9f50-43ae-a21e-62aba2b35a3a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:49.126918 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-71dfbe0c-9f50-43ae-a21e-62aba2b35a3a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:49.129041 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-71dfbe0c-9f50-43ae-a21e-62aba2b35a3a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:49.130890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-71dfbe0c-9f50-43ae-a21e-62aba2b35a3a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1408 microversion: 2.20 time: 0.410013 Jul 04 04:21:49.142462 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 384/781] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:21:48 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1408 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:21:49.163567 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-8a1549b1-05b7-4933-b9f6-a7d9d70941c9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:49.164607 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-8a1549b1-05b7-4933-b9f6-a7d9d70941c9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:49.173256 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8a1549b1-05b7-4933-b9f6-a7d9d70941c9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:49.173913 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8a1549b1-05b7-4933-b9f6-a7d9d70941c9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:49.174911 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8a1549b1-05b7-4933-b9f6-a7d9d70941c9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:49.175524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8a1549b1-05b7-4933-b9f6-a7d9d70941c9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:49.472599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-8a1549b1-05b7-4933-b9f6-a7d9d70941c9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:49.485872 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-8a1549b1-05b7-4933-b9f6-a7d9d70941c9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1265 microversion: 2.1 time: 0.332460 Jul 04 04:21:49.487408 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 398/782] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:49 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1265 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:50.149835 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-13559292-b176-4e8d-8f18-4b720bdc5d0a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:50.151154 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-13559292-b176-4e8d-8f18-4b720bdc5d0a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:50.157747 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13559292-b176-4e8d-8f18-4b720bdc5d0a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:50.158439 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13559292-b176-4e8d-8f18-4b720bdc5d0a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:50.159470 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13559292-b176-4e8d-8f18-4b720bdc5d0a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:50.160080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13559292-b176-4e8d-8f18-4b720bdc5d0a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:50.326907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-13559292-b176-4e8d-8f18-4b720bdc5d0a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:50.338997 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-13559292-b176-4e8d-8f18-4b720bdc5d0a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:50.343010 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-13559292-b176-4e8d-8f18-4b720bdc5d0a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:50.346064 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-13559292-b176-4e8d-8f18-4b720bdc5d0a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1408 microversion: 2.20 time: 0.199101 Jul 04 04:21:50.346698 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 385/783] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:21:50 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:21:50.503228 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-8595f3cc-d3e1-4903-993f-b3fcbc720b02 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:50.505801 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-8595f3cc-d3e1-4903-993f-b3fcbc720b02 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:50.518772 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8595f3cc-d3e1-4903-993f-b3fcbc720b02 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:50.519339 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8595f3cc-d3e1-4903-993f-b3fcbc720b02 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:50.520235 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8595f3cc-d3e1-4903-993f-b3fcbc720b02 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:50.521666 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8595f3cc-d3e1-4903-993f-b3fcbc720b02 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:50.756333 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-8595f3cc-d3e1-4903-993f-b3fcbc720b02 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:50.764112 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-8595f3cc-d3e1-4903-993f-b3fcbc720b02 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1265 microversion: 2.1 time: 0.264883 Jul 04 04:21:50.770641 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 399/784] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:50 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:51.305690 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-08af563c-9340-4693-9d45-0722cbade7e4 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Action: 'create', calling method: .version_select at 0x7f50c0f48160>, body: {"keypair": {"name": "tempest-keypair-503811916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNl5AvUk5vZTxlvhqIuG//gskrYKcWAZI4YXuDI/7rsMqov4XeDveHxR/t444rqsifidwj/jl8m006CzbN9xcpZw0oWpvqcdthX+nIQ5i70tnaomef27Wk4KlLO/6bpxZw=="}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:21:51.321165 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-08af563c-9340-4693-9d45-0722cbade7e4 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Getting quotas for project 0bd3f8996b5b46f6904e32023b092e5d. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:21:51.325460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-08af563c-9340-4693-9d45-0722cbade7e4 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Getting quotas for user ccf66c5198f24f7cbc39132635c03611 and project 0bd3f8996b5b46f6904e32023b092e5d. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:21:51.348249 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-08af563c-9340-4693-9d45-0722cbade7e4 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.168694 Jul 04 04:21:51.348854 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 386/785] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jul 4 04:21:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:21:51.363750 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-07fca642-9476-45e8-af1a-5bd7101a82a9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:51.364360 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-07fca642-9476-45e8-af1a-5bd7101a82a9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:51.370962 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-07fca642-9476-45e8-af1a-5bd7101a82a9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:51.371709 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-07fca642-9476-45e8-af1a-5bd7101a82a9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:51.372684 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-07fca642-9476-45e8-af1a-5bd7101a82a9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:51.373300 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-07fca642-9476-45e8-af1a-5bd7101a82a9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:51.588405 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-07fca642-9476-45e8-af1a-5bd7101a82a9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:51.619502 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-07fca642-9476-45e8-af1a-5bd7101a82a9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:51.621784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-07fca642-9476-45e8-af1a-5bd7101a82a9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:51.623927 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-07fca642-9476-45e8-af1a-5bd7101a82a9 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1408 microversion: 2.20 time: 0.264280 Jul 04 04:21:51.625038 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 400/786] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:21:51 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:21:51.783577 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e178419c-78c4-49bf-b842-a7ea4d2abd87 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:51.784208 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e178419c-78c4-49bf-b842-a7ea4d2abd87 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:51.791402 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e178419c-78c4-49bf-b842-a7ea4d2abd87 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:51.791855 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e178419c-78c4-49bf-b842-a7ea4d2abd87 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:51.792638 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e178419c-78c4-49bf-b842-a7ea4d2abd87 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:51.793471 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e178419c-78c4-49bf-b842-a7ea4d2abd87 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:52.066577 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e178419c-78c4-49bf-b842-a7ea4d2abd87 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:52.075912 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e178419c-78c4-49bf-b842-a7ea4d2abd87 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1265 microversion: 2.1 time: 0.298519 Jul 04 04:21:52.076587 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 387/787] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:51 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1265 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:52.642424 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-0bb32f58-7daf-4aa9-85fd-71f178e84b2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:52.643547 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-0bb32f58-7daf-4aa9-85fd-71f178e84b2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:52.653060 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0bb32f58-7daf-4aa9-85fd-71f178e84b2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:52.653878 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0bb32f58-7daf-4aa9-85fd-71f178e84b2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:52.654836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0bb32f58-7daf-4aa9-85fd-71f178e84b2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:52.655458 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0bb32f58-7daf-4aa9-85fd-71f178e84b2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:52.847374 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-c8389d73-c6d6-4177-b294-d8672c158c3a req-1843e92f-a070-463c-b8b7-bf26bf919b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07bec57-64a0-4669-9cb5-6d54d72b8f20", "name": "network-vif-plugged", "status": "completed", "tag": "2bb1a3cb-fe02-4fa0-814e-4fcbd93520ba"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:21:52.865711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c8389d73-c6d6-4177-b294-d8672c158c3a req-1843e92f-a070-463c-b8b7-bf26bf919b2d service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:52.866298 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c8389d73-c6d6-4177-b294-d8672c158c3a req-1843e92f-a070-463c-b8b7-bf26bf919b2d service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:52.884014 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-c8389d73-c6d6-4177-b294-d8672c158c3a req-1843e92f-a070-463c-b8b7-bf26bf919b2d service nova] Creating event network-vif-plugged:2bb1a3cb-fe02-4fa0-814e-4fcbd93520ba for instance e07bec57-64a0-4669-9cb5-6d54d72b8f20 on hv-cinder-74216 Jul 04 04:21:52.891670 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-c8389d73-c6d6-4177-b294-d8672c158c3a req-1843e92f-a070-463c-b8b7-bf26bf919b2d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049777 Jul 04 04:21:52.893754 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 388/788] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:21:52.909490 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-0bb32f58-7daf-4aa9-85fd-71f178e84b2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:52.921145 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-0bb32f58-7daf-4aa9-85fd-71f178e84b2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:52.922679 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-0bb32f58-7daf-4aa9-85fd-71f178e84b2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:52.923812 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-0bb32f58-7daf-4aa9-85fd-71f178e84b2b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1408 microversion: 2.20 time: 0.285496 Jul 04 04:21:52.924683 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 401/789] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:21:52 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:21:52.942385 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b50f8ccb-9826-4b9b-a9c5-f73ad492045c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-331654323", "imageRef": "46b9937d-f997-401a-a3aa-bb9028764454", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d24f9b7-eac9-447b-b6d4-fce3782f951d"}], "security_groups": [{"name": "tempest-securitygroup--1390696087"}], "key_name": "tempest-keypair-503811916", "user_data": "}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:21:53.052313 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-b50f8ccb-9826-4b9b-a9c5-f73ad492045c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] validate_networks() for [('1d24f9b7-eac9-447b-b6d4-fce3782f951d', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:21:53.095178 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-0378ee99-54fe-4bf0-a6cc-43a6096cbb72 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:53.096216 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-0378ee99-54fe-4bf0-a6cc-43a6096cbb72 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:53.104570 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0378ee99-54fe-4bf0-a6cc-43a6096cbb72 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:53.105485 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0378ee99-54fe-4bf0-a6cc-43a6096cbb72 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:53.106603 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0378ee99-54fe-4bf0-a6cc-43a6096cbb72 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:53.107497 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0378ee99-54fe-4bf0-a6cc-43a6096cbb72 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:53.278103 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-0378ee99-54fe-4bf0-a6cc-43a6096cbb72 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:53.287196 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-0378ee99-54fe-4bf0-a6cc-43a6096cbb72 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1265 microversion: 2.1 time: 0.197664 Jul 04 04:21:53.297109 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 402/790] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:53 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:21:53.524624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-b50f8ccb-9826-4b9b-a9c5-f73ad492045c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:21:53.525047 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-b50f8ccb-9826-4b9b-a9c5-f73ad492045c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:21:53.525521 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-b50f8ccb-9826-4b9b-a9c5-f73ad492045c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:21:53.525922 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-b50f8ccb-9826-4b9b-a9c5-f73ad492045c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:21:53.526331 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-b50f8ccb-9826-4b9b-a9c5-f73ad492045c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:21:53.535978 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b50f8ccb-9826-4b9b-a9c5-f73ad492045c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:53.536387 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b50f8ccb-9826-4b9b-a9c5-f73ad492045c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:53.537205 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b50f8ccb-9826-4b9b-a9c5-f73ad492045c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:53.537637 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b50f8ccb-9826-4b9b-a9c5-f73ad492045c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:53.555025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-b50f8ccb-9826-4b9b-a9c5-f73ad492045c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Getting quotas for project 0bd3f8996b5b46f6904e32023b092e5d. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:21:53.559185 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-b50f8ccb-9826-4b9b-a9c5-f73ad492045c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Getting quotas for user ccf66c5198f24f7cbc39132635c03611 and project 0bd3f8996b5b46f6904e32023b092e5d. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:21:53.570066 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b50f8ccb-9826-4b9b-a9c5-f73ad492045c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:21:53.572468 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b50f8ccb-9826-4b9b-a9c5-f73ad492045c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46b9937d-f997-401a-a3aa-bb9028764454',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:21:53.618699 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b50f8ccb-9826-4b9b-a9c5-f73ad492045c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.682929 Jul 04 04:21:53.619569 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 389/791] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:21:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 04:21:53.631120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c6a69dc4-6a4b-4697-84ed-2cc44f722ec8 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:53.632396 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c6a69dc4-6a4b-4697-84ed-2cc44f722ec8 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:53.716653 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c6a69dc4-6a4b-4697-84ed-2cc44f722ec8 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:53.724243 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c6a69dc4-6a4b-4697-84ed-2cc44f722ec8 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1236 microversion: 2.1 time: 0.097981 Jul 04 04:21:53.726589 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 403/792] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:53 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1236 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:53.946223 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-80367ad4-cec7-48c2-87d0-4b861188a54b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:53.946827 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-80367ad4-cec7-48c2-87d0-4b861188a54b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:53.953973 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80367ad4-cec7-48c2-87d0-4b861188a54b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:53.954429 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80367ad4-cec7-48c2-87d0-4b861188a54b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:53.955219 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80367ad4-cec7-48c2-87d0-4b861188a54b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:53.955650 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80367ad4-cec7-48c2-87d0-4b861188a54b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:54.098323 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-80367ad4-cec7-48c2-87d0-4b861188a54b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:54.108293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-80367ad4-cec7-48c2-87d0-4b861188a54b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:54.109770 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-80367ad4-cec7-48c2-87d0-4b861188a54b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:54.110920 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-80367ad4-cec7-48c2-87d0-4b861188a54b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1408 microversion: 2.20 time: 0.169422 Jul 04 04:21:54.111478 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 390/793] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:21:53 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:21:54.306353 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-044eee66-454c-46ab-8fdf-0bac55bdf956 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:54.307117 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-044eee66-454c-46ab-8fdf-0bac55bdf956 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:54.315554 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-044eee66-454c-46ab-8fdf-0bac55bdf956 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:54.316540 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-044eee66-454c-46ab-8fdf-0bac55bdf956 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:54.317698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-044eee66-454c-46ab-8fdf-0bac55bdf956 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:54.318877 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-044eee66-454c-46ab-8fdf-0bac55bdf956 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:54.478766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-044eee66-454c-46ab-8fdf-0bac55bdf956 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:54.487315 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-044eee66-454c-46ab-8fdf-0bac55bdf956 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1265 microversion: 2.1 time: 0.186594 Jul 04 04:21:54.488101 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 404/794] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:54 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:54.747579 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-21f4e6f1-ae3c-4c78-b77e-598f8929c95f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:54.748328 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-21f4e6f1-ae3c-4c78-b77e-598f8929c95f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:54.755142 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21f4e6f1-ae3c-4c78-b77e-598f8929c95f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:54.755761 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21f4e6f1-ae3c-4c78-b77e-598f8929c95f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:54.756856 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21f4e6f1-ae3c-4c78-b77e-598f8929c95f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:54.757453 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21f4e6f1-ae3c-4c78-b77e-598f8929c95f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:54.865965 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-21f4e6f1-ae3c-4c78-b77e-598f8929c95f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:54.870868 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:54.881447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-21f4e6f1-ae3c-4c78-b77e-598f8929c95f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1288 microversion: 2.1 time: 0.144036 Jul 04 04:21:54.882035 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 391/795] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:54 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1288 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:55.060816 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-eb1e0072-5c8c-4c90-87b1-fc0d1da34148 req-50e0619a-afd2-4c92-8c21-167d35b58aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb99d59a-d33a-48d2-9824-25f44c1f32c1", "name": "network-vif-plugged", "status": "completed", "tag": "f6b7b5f9-dfd8-4f10-99f9-c155d967e2de"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:21:55.070247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-eb1e0072-5c8c-4c90-87b1-fc0d1da34148 req-50e0619a-afd2-4c92-8c21-167d35b58aca service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:55.070775 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-eb1e0072-5c8c-4c90-87b1-fc0d1da34148 req-50e0619a-afd2-4c92-8c21-167d35b58aca service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:55.082473 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-eb1e0072-5c8c-4c90-87b1-fc0d1da34148 req-50e0619a-afd2-4c92-8c21-167d35b58aca service nova] Creating event network-vif-plugged:f6b7b5f9-dfd8-4f10-99f9-c155d967e2de for instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 on hv-cinder-74216 Jul 04 04:21:55.087783 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-eb1e0072-5c8c-4c90-87b1-fc0d1da34148 req-50e0619a-afd2-4c92-8c21-167d35b58aca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030844 Jul 04 04:21:55.088535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 405/796] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:21:55.129089 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6608f5ae-35bf-4f01-80e1-c2f49bb02175 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:55.130332 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6608f5ae-35bf-4f01-80e1-c2f49bb02175 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:55.137889 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6608f5ae-35bf-4f01-80e1-c2f49bb02175 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:55.138338 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6608f5ae-35bf-4f01-80e1-c2f49bb02175 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:55.139146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6608f5ae-35bf-4f01-80e1-c2f49bb02175 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:55.139570 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6608f5ae-35bf-4f01-80e1-c2f49bb02175 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:55.293322 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6608f5ae-35bf-4f01-80e1-c2f49bb02175 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:55.317689 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6608f5ae-35bf-4f01-80e1-c2f49bb02175 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:55.319747 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6608f5ae-35bf-4f01-80e1-c2f49bb02175 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:55.320946 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6608f5ae-35bf-4f01-80e1-c2f49bb02175 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1408 microversion: 2.20 time: 0.195884 Jul 04 04:21:55.322735 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 392/797] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:21:55 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:21:55.506545 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c60976e1-6991-43de-9fa8-b7bc759af235 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:55.507313 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c60976e1-6991-43de-9fa8-b7bc759af235 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:55.514893 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=2 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:55.517112 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c60976e1-6991-43de-9fa8-b7bc759af235 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:55.517760 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c60976e1-6991-43de-9fa8-b7bc759af235 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:55.518900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c60976e1-6991-43de-9fa8-b7bc759af235 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:55.519709 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c60976e1-6991-43de-9fa8-b7bc759af235 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:55.900346 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eea593e1-c455-4a58-857b-e77d797331d1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:55.901064 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eea593e1-c455-4a58-857b-e77d797331d1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:55.913391 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eea593e1-c455-4a58-857b-e77d797331d1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:55.913928 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eea593e1-c455-4a58-857b-e77d797331d1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:55.914836 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eea593e1-c455-4a58-857b-e77d797331d1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:55.915354 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eea593e1-c455-4a58-857b-e77d797331d1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:55.986495 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c60976e1-6991-43de-9fa8-b7bc759af235 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:55.994591 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c60976e1-6991-43de-9fa8-b7bc759af235 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1451 microversion: 2.1 time: 0.493546 Jul 04 04:21:55.995182 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 406/798] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:55 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1451 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:56.012038 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ba24ea14-f0ef-46c2-b32c-2bccf18e2cf9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:56.013001 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-ba24ea14-f0ef-46c2-b32c-2bccf18e2cf9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:56.019795 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ba24ea14-f0ef-46c2-b32c-2bccf18e2cf9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:56.020275 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ba24ea14-f0ef-46c2-b32c-2bccf18e2cf9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:56.021094 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ba24ea14-f0ef-46c2-b32c-2bccf18e2cf9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:56.021530 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ba24ea14-f0ef-46c2-b32c-2bccf18e2cf9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:56.164416 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-ba24ea14-f0ef-46c2-b32c-2bccf18e2cf9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:56.172651 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ba24ea14-f0ef-46c2-b32c-2bccf18e2cf9 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1451 microversion: 2.1 time: 0.164857 Jul 04 04:21:56.173477 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 407/799] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:56 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:56.270011 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eea593e1-c455-4a58-857b-e77d797331d1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:56.278113 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eea593e1-c455-4a58-857b-e77d797331d1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1294 microversion: 2.1 time: 0.382042 Jul 04 04:21:56.288452 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 393/800] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:55 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1294 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:21:56.339059 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5fa2404c-4276-4feb-949e-e4984a594e67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:56.340085 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5fa2404c-4276-4feb-949e-e4984a594e67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:56.346545 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5fa2404c-4276-4feb-949e-e4984a594e67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:56.346993 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5fa2404c-4276-4feb-949e-e4984a594e67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:56.347947 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5fa2404c-4276-4feb-949e-e4984a594e67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:56.348578 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5fa2404c-4276-4feb-949e-e4984a594e67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:56.560358 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5fa2404c-4276-4feb-949e-e4984a594e67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:56.569273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5fa2404c-4276-4feb-949e-e4984a594e67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:56.571393 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5fa2404c-4276-4feb-949e-e4984a594e67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:56.572833 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5fa2404c-4276-4feb-949e-e4984a594e67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1408 microversion: 2.20 time: 0.237890 Jul 04 04:21:56.584432 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 408/801] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:21:56 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:21:57.295893 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4245f2be-b9ec-45ae-a6f3-15e622240c58 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:57.297128 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4245f2be-b9ec-45ae-a6f3-15e622240c58 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:57.303992 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4245f2be-b9ec-45ae-a6f3-15e622240c58 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:57.305358 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4245f2be-b9ec-45ae-a6f3-15e622240c58 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:57.306738 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4245f2be-b9ec-45ae-a6f3-15e622240c58 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:57.307356 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4245f2be-b9ec-45ae-a6f3-15e622240c58 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:57.557262 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4245f2be-b9ec-45ae-a6f3-15e622240c58 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:57.565499 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4245f2be-b9ec-45ae-a6f3-15e622240c58 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1362 microversion: 2.1 time: 0.273531 Jul 04 04:21:57.566308 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 394/802] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:57 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:57.591901 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-feaa07da-14e5-4eef-874e-4209d554604a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:57.593024 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-feaa07da-14e5-4eef-874e-4209d554604a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:57.599893 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-feaa07da-14e5-4eef-874e-4209d554604a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:57.600529 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-feaa07da-14e5-4eef-874e-4209d554604a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:57.601288 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-feaa07da-14e5-4eef-874e-4209d554604a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:57.601713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-feaa07da-14e5-4eef-874e-4209d554604a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:57.641774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-264eb2e9-7d08-4d75-b36c-8c5523b1d7fe req-5a9fa7b2-ef8f-4f58-9fb5-a2afcf612b02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb5a126f-e314-44bc-8697-7b07760da296", "tag": "85defb10-99ae-43aa-8776-2102f58dfbac"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:21:57.650098 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-264eb2e9-7d08-4d75-b36c-8c5523b1d7fe req-5a9fa7b2-ef8f-4f58-9fb5-a2afcf612b02 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:57.650813 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-264eb2e9-7d08-4d75-b36c-8c5523b1d7fe req-5a9fa7b2-ef8f-4f58-9fb5-a2afcf612b02 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:57.667989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-264eb2e9-7d08-4d75-b36c-8c5523b1d7fe req-5a9fa7b2-ef8f-4f58-9fb5-a2afcf612b02 service nova] Creating event network-changed:85defb10-99ae-43aa-8776-2102f58dfbac for instance fb5a126f-e314-44bc-8697-7b07760da296 on hv-cinder-74216 Jul 04 04:21:57.674138 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-264eb2e9-7d08-4d75-b36c-8c5523b1d7fe req-5a9fa7b2-ef8f-4f58-9fb5-a2afcf612b02 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036585 Jul 04 04:21:57.675112 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 395/803] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:21:57.855646 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-feaa07da-14e5-4eef-874e-4209d554604a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:57.863753 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-feaa07da-14e5-4eef-874e-4209d554604a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:57.865240 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-feaa07da-14e5-4eef-874e-4209d554604a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:57.866438 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-feaa07da-14e5-4eef-874e-4209d554604a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1600 microversion: 2.20 time: 0.278968 Jul 04 04:21:57.867238 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 409/804] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:21:57 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1600 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:21:57.884729 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3a35d91e-808a-4f87-b7d3-753815b783ac tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:57.885539 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3a35d91e-808a-4f87-b7d3-753815b783ac tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:57.892673 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a35d91e-808a-4f87-b7d3-753815b783ac tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:57.893110 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a35d91e-808a-4f87-b7d3-753815b783ac tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:57.894041 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a35d91e-808a-4f87-b7d3-753815b783ac tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:57.894743 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3a35d91e-808a-4f87-b7d3-753815b783ac tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:57.994560 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3a35d91e-808a-4f87-b7d3-753815b783ac tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.114031 Jul 04 04:21:57.995245 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 396/805] 10.222.0.16 () {60 vars in 1315 bytes} [Mon Jul 4 04:21:57 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:21:58.182402 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-76143e30-fb91-419d-a8d6-cb962c8cb7b0 req-19327101-9fd2-4c04-8efc-04bd8b998544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e07bec57-64a0-4669-9cb5-6d54d72b8f20", "tag": "2bb1a3cb-fe02-4fa0-814e-4fcbd93520ba"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:21:58.191260 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-76143e30-fb91-419d-a8d6-cb962c8cb7b0 req-19327101-9fd2-4c04-8efc-04bd8b998544 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:58.191957 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-76143e30-fb91-419d-a8d6-cb962c8cb7b0 req-19327101-9fd2-4c04-8efc-04bd8b998544 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:58.203750 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-76143e30-fb91-419d-a8d6-cb962c8cb7b0 req-19327101-9fd2-4c04-8efc-04bd8b998544 service nova] Creating event network-changed:2bb1a3cb-fe02-4fa0-814e-4fcbd93520ba for instance e07bec57-64a0-4669-9cb5-6d54d72b8f20 on hv-cinder-74216 Jul 04 04:21:58.209094 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-76143e30-fb91-419d-a8d6-cb962c8cb7b0 req-19327101-9fd2-4c04-8efc-04bd8b998544 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030270 Jul 04 04:21:58.210484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 410/806] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:21:58.587183 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-27799172-4e04-4c2e-a2d8-b47fb039480a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:58.588442 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-27799172-4e04-4c2e-a2d8-b47fb039480a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:58.595614 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27799172-4e04-4c2e-a2d8-b47fb039480a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:58.596059 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27799172-4e04-4c2e-a2d8-b47fb039480a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:58.596827 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27799172-4e04-4c2e-a2d8-b47fb039480a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:58.597256 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-27799172-4e04-4c2e-a2d8-b47fb039480a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:58.755459 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-27799172-4e04-4c2e-a2d8-b47fb039480a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:58.765232 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-27799172-4e04-4c2e-a2d8-b47fb039480a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1362 microversion: 2.1 time: 0.183335 Jul 04 04:21:58.766431 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 397/807] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:58 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:21:59.783944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-52dc1f28-2043-464b-8d83-247020d60518 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:21:59.784601 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-52dc1f28-2043-464b-8d83-247020d60518 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:21:59.791259 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-52dc1f28-2043-464b-8d83-247020d60518 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:59.791701 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-52dc1f28-2043-464b-8d83-247020d60518 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:59.792459 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-52dc1f28-2043-464b-8d83-247020d60518 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:21:59.792900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-52dc1f28-2043-464b-8d83-247020d60518 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:21:59.925225 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-52dc1f28-2043-464b-8d83-247020d60518 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:21:59.933091 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-52dc1f28-2043-464b-8d83-247020d60518 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1362 microversion: 2.1 time: 0.153890 Jul 04 04:21:59.933658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 411/808] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:21:59 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:00.261414 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-4b150049-1e39-45d1-99bc-a7bb1f2a5482 req-c4db2b59-68c6-4b5a-8c89-37bacf795630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb99d59a-d33a-48d2-9824-25f44c1f32c1", "tag": "f6b7b5f9-dfd8-4f10-99f9-c155d967e2de"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:22:00.271121 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-4b150049-1e39-45d1-99bc-a7bb1f2a5482 req-c4db2b59-68c6-4b5a-8c89-37bacf795630 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:00.271569 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-4b150049-1e39-45d1-99bc-a7bb1f2a5482 req-c4db2b59-68c6-4b5a-8c89-37bacf795630 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:00.283678 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-4b150049-1e39-45d1-99bc-a7bb1f2a5482 req-c4db2b59-68c6-4b5a-8c89-37bacf795630 service nova] Creating event network-changed:f6b7b5f9-dfd8-4f10-99f9-c155d967e2de for instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 on hv-cinder-74216 Jul 04 04:22:00.288649 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-4b150049-1e39-45d1-99bc-a7bb1f2a5482 req-c4db2b59-68c6-4b5a-8c89-37bacf795630 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031003 Jul 04 04:22:00.289255 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 398/809] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:22:00.956620 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b324c23a-2dac-4da0-b4d5-2a712e04390d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:00.957380 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b324c23a-2dac-4da0-b4d5-2a712e04390d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:00.964465 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b324c23a-2dac-4da0-b4d5-2a712e04390d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:00.964960 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b324c23a-2dac-4da0-b4d5-2a712e04390d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:00.965924 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b324c23a-2dac-4da0-b4d5-2a712e04390d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:00.966355 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b324c23a-2dac-4da0-b4d5-2a712e04390d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:01.099725 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b324c23a-2dac-4da0-b4d5-2a712e04390d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:01.107359 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b324c23a-2dac-4da0-b4d5-2a712e04390d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1362 microversion: 2.1 time: 0.161929 Jul 04 04:22:01.107937 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 412/810] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:00 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:02.126026 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-99d217ab-ba0a-4fe2-9d62-68587002ddc7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:02.126740 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-99d217ab-ba0a-4fe2-9d62-68587002ddc7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:02.134155 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99d217ab-ba0a-4fe2-9d62-68587002ddc7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:02.134636 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99d217ab-ba0a-4fe2-9d62-68587002ddc7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:02.135410 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99d217ab-ba0a-4fe2-9d62-68587002ddc7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:02.135841 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99d217ab-ba0a-4fe2-9d62-68587002ddc7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:02.274246 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-99d217ab-ba0a-4fe2-9d62-68587002ddc7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:02.285837 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-99d217ab-ba0a-4fe2-9d62-68587002ddc7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1362 microversion: 2.1 time: 0.163845 Jul 04 04:22:02.286718 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 399/811] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:02 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:03.308856 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ee40cdb8-0e9b-4193-a8e0-ebe534f28130 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:03.309438 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-ee40cdb8-0e9b-4193-a8e0-ebe534f28130 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:03.317063 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ee40cdb8-0e9b-4193-a8e0-ebe534f28130 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:03.317684 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ee40cdb8-0e9b-4193-a8e0-ebe534f28130 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:03.318879 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ee40cdb8-0e9b-4193-a8e0-ebe534f28130 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:03.319536 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ee40cdb8-0e9b-4193-a8e0-ebe534f28130 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:03.465915 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-ee40cdb8-0e9b-4193-a8e0-ebe534f28130 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:03.473795 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ee40cdb8-0e9b-4193-a8e0-ebe534f28130 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1362 microversion: 2.1 time: 0.168936 Jul 04 04:22:03.474391 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 413/812] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:03 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:04.499508 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aa420e79-6a07-478a-9317-6a5747072f83 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:04.500557 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aa420e79-6a07-478a-9317-6a5747072f83 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:04.504437 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:22:04.505525 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=12 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:22:04.514059 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa420e79-6a07-478a-9317-6a5747072f83 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:04.514558 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa420e79-6a07-478a-9317-6a5747072f83 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:04.515323 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa420e79-6a07-478a-9317-6a5747072f83 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:04.515750 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa420e79-6a07-478a-9317-6a5747072f83 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:04.657257 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aa420e79-6a07-478a-9317-6a5747072f83 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:04.664901 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aa420e79-6a07-478a-9317-6a5747072f83 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1362 microversion: 2.1 time: 0.172116 Jul 04 04:22:04.665453 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 400/813] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:04 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:04.747492 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-a1e3bf79-c211-47f7-9cee-e479ac7e1fe4 req-26801aeb-adb2-46fb-870c-4467e1e49519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5a126f-e314-44bc-8697-7b07760da296", "name": "network-vif-plugged", "status": "completed", "tag": "85defb10-99ae-43aa-8776-2102f58dfbac"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:22:04.751405 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=18 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:22:04.759888 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-a1e3bf79-c211-47f7-9cee-e479ac7e1fe4 req-26801aeb-adb2-46fb-870c-4467e1e49519 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:04.760453 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-a1e3bf79-c211-47f7-9cee-e479ac7e1fe4 req-26801aeb-adb2-46fb-870c-4467e1e49519 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:04.772768 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-a1e3bf79-c211-47f7-9cee-e479ac7e1fe4 req-26801aeb-adb2-46fb-870c-4467e1e49519 service nova] Creating event network-vif-plugged:85defb10-99ae-43aa-8776-2102f58dfbac for instance fb5a126f-e314-44bc-8697-7b07760da296 on hv-cinder-74216 Jul 04 04:22:04.779576 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-a1e3bf79-c211-47f7-9cee-e479ac7e1fe4 req-26801aeb-adb2-46fb-870c-4467e1e49519 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035897 Jul 04 04:22:04.780387 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 414/814] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:22:05.682691 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c84dee90-6f84-48d0-b1fc-c97ede7194f1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:05.683503 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c84dee90-6f84-48d0-b1fc-c97ede7194f1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:05.690786 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c84dee90-6f84-48d0-b1fc-c97ede7194f1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:05.691233 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c84dee90-6f84-48d0-b1fc-c97ede7194f1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:05.692031 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c84dee90-6f84-48d0-b1fc-c97ede7194f1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:05.692461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c84dee90-6f84-48d0-b1fc-c97ede7194f1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:05.833287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c84dee90-6f84-48d0-b1fc-c97ede7194f1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:05.841078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c84dee90-6f84-48d0-b1fc-c97ede7194f1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1362 microversion: 2.1 time: 0.162497 Jul 04 04:22:05.841649 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 401/815] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:05 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:06.860560 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-df3fd7c3-2e5d-4841-8961-3999536451e7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:06.861504 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-df3fd7c3-2e5d-4841-8961-3999536451e7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:06.872980 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-df3fd7c3-2e5d-4841-8961-3999536451e7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:06.873658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-df3fd7c3-2e5d-4841-8961-3999536451e7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:06.874919 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-df3fd7c3-2e5d-4841-8961-3999536451e7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:06.875579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-df3fd7c3-2e5d-4841-8961-3999536451e7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:07.015317 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-df3fd7c3-2e5d-4841-8961-3999536451e7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:07.024323 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-df3fd7c3-2e5d-4841-8961-3999536451e7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1548 microversion: 2.1 time: 0.169934 Jul 04 04:22:07.034915 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 415/816] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:06 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:07.044273 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9f1521a7-4482-47b6-9376-b0e5febb9cb3 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:07.044771 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9f1521a7-4482-47b6-9376-b0e5febb9cb3 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:07.051623 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f1521a7-4482-47b6-9376-b0e5febb9cb3 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:07.052082 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f1521a7-4482-47b6-9376-b0e5febb9cb3 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:07.052848 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f1521a7-4482-47b6-9376-b0e5febb9cb3 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:07.053286 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f1521a7-4482-47b6-9376-b0e5febb9cb3 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:07.138102 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9f1521a7-4482-47b6-9376-b0e5febb9cb3 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098352 Jul 04 04:22:07.138770 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 402/817] 10.222.0.16 () {58 vars in 1274 bytes} [Mon Jul 4 04:22:07 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:22:08.090307 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-66cbb29e-4225-464a-b794-b0874a6e4006 req-1dfec500-0b91-45c5-a0c8-b605a010cf4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb5a126f-e314-44bc-8697-7b07760da296", "tag": "85defb10-99ae-43aa-8776-2102f58dfbac"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:22:08.099281 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-66cbb29e-4225-464a-b794-b0874a6e4006 req-1dfec500-0b91-45c5-a0c8-b605a010cf4b service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:08.099741 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-66cbb29e-4225-464a-b794-b0874a6e4006 req-1dfec500-0b91-45c5-a0c8-b605a010cf4b service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:08.111232 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-66cbb29e-4225-464a-b794-b0874a6e4006 req-1dfec500-0b91-45c5-a0c8-b605a010cf4b service nova] Creating event network-changed:85defb10-99ae-43aa-8776-2102f58dfbac for instance fb5a126f-e314-44bc-8697-7b07760da296 on hv-cinder-74216 Jul 04 04:22:08.116072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-66cbb29e-4225-464a-b794-b0874a6e4006 req-1dfec500-0b91-45c5-a0c8-b605a010cf4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029960 Jul 04 04:22:08.116635 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 416/818] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:22:27.864160 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:22:27.865353 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=55 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:22:27.871819 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e4358dff-47d8-4eb0-b67e-37371cd9d284 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:27.872624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e4358dff-47d8-4eb0-b67e-37371cd9d284 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:27.885679 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4358dff-47d8-4eb0-b67e-37371cd9d284 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:27.886843 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4358dff-47d8-4eb0-b67e-37371cd9d284 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:27.888113 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4358dff-47d8-4eb0-b67e-37371cd9d284 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:27.888834 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4358dff-47d8-4eb0-b67e-37371cd9d284 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:27.915680 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e4358dff-47d8-4eb0-b67e-37371cd9d284 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb/ips" status: 200 len: 150 microversion: 2.1 time: 0.053873 Jul 04 04:22:27.916172 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 403/819] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jul 4 04:22:27 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:22:29.267633 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:22:29.268381 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=99 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:22:29.273303 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ba6bdf9c-5d5d-4625-b32a-a26066cc19c1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5843607-d7cf-4901-974e-2cc27e698a24"}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:22:29.274520 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-ba6bdf9c-5d5d-4625-b32a-a26066cc19c1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:29.281988 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ba6bdf9c-5d5d-4625-b32a-a26066cc19c1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:29.282510 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ba6bdf9c-5d5d-4625-b32a-a26066cc19c1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:29.283265 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ba6bdf9c-5d5d-4625-b32a-a26066cc19c1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:29.283697 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ba6bdf9c-5d5d-4625-b32a-a26066cc19c1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:29.566556 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ba6bdf9c-5d5d-4625-b32a-a26066cc19c1 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "POST /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300277 Jul 04 04:22:29.567198 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 417/820] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jul 4 04:22:29 2022] POST /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:22:37.105931 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fa2e63b5-3cdb-4576-a07c-6a49643b8b14 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5843607-d7cf-4901-974e-2cc27e698a24"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:22:37.107046 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fa2e63b5-3cdb-4576-a07c-6a49643b8b14 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:37.113377 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa2e63b5-3cdb-4576-a07c-6a49643b8b14 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:37.113828 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa2e63b5-3cdb-4576-a07c-6a49643b8b14 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:37.114642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa2e63b5-3cdb-4576-a07c-6a49643b8b14 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:37.115087 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa2e63b5-3cdb-4576-a07c-6a49643b8b14 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:37.207743 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-fa2e63b5-3cdb-4576-a07c-6a49643b8b14 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] HTTP exception thrown: Invalid volume: volume d5843607-d7cf-4901-974e-2cc27e698a24 is already attached to instances: 8504f7ec-3a32-4230-ad65-61da993f52bb Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fa2e63b5-3cdb-4576-a07c-6a49643b8b14 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Request method failure captured: Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: POST /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb/os-volume_attachments HTTP/1.1 Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 74 Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmkvvNXviK4RHs-pC2ZUGxhjzRMF8G1iwt3QQvENmXB_WKs6Un0uo-bkU60UeA5mbFaWI8DULlMS96BRMKHcqOYLorEFYdRp34ZJFtZG4dJDmi0fE-jBVj7rCHrbsjhLZ51yhgpFUDC-ASYnpBPbmkcyUWrK8JyNvv4uGci2lLUQkr4 Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:22:37.209476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:22:37.211069 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ccd298eebe6413daaae0d801e902616", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:22:37.211069 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:22:37.211069 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:22:37.211069 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:22:37.211069 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:22:37.211069 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:22:37.211069 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:22:37.211069 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: 4041faa2919d4760ae10907070a10dc7 Jul 04 04:22:37.211069 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:22:37.211069 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Jul 04 04:22:37.211069 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {"volumeAttachment": {"volumeId": "d5843607-d7cf-4901-974e-2cc27e698a24"}} Jul 04 04:22:37.211069 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:22:37.212831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Invalid volume: volume d5843607-d7cf-4901-974e-2cc27e698a24 is already attached to instances: 8504f7ec-3a32-4230-ad65-61da993f52bb Jul 04 04:22:37.212831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'server_id': '8504f7ec-3a32-4230-ad65-61da993f52bb', 'body': {'volumeAttachment': {'volumeId': 'd5843607-d7cf-4901-974e-2cc27e698a24'}}} Jul 04 04:22:37.212831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:22:37.212831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:22:37.212831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 04 04:22:37.212831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 04 04:22:37.212831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 04:22:37.212831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 04:22:37.212831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 04 04:22:37.212831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 04 04:22:37.212831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 04 04:22:37.212831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 04 04:22:37.212831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 04 04:22:37.212831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 04 04:22:37.212831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d5843607-d7cf-4901-974e-2cc27e698a24 is already attached to instances: 8504f7ec-3a32-4230-ad65-61da993f52bb Jul 04 04:22:37.212831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:22:37.212831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:22:37.212831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:22:37.212831 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d5843607-d7cf-4901-974e-2cc27e698a24 is already attached to instances: 8504f7ec-3a32-4230-ad65-61da993f52bb Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:22:37.214275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:22:37.215674 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:22:37.215674 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:22:37.215674 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:22:37.215674 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d5843607-d7cf-4901-974e-2cc27e698a24 is already attached to instances: 8504f7ec-3a32-4230-ad65-61da993f52bb Jul 04 04:22:37.215674 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:22:37.215674 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fa2e63b5-3cdb-4576-a07c-6a49643b8b14 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Returning 400 to user: Invalid volume: volume d5843607-d7cf-4901-974e-2cc27e698a24 is already attached to instances: 8504f7ec-3a32-4230-ad65-61da993f52bb {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:22:37.215674 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fa2e63b5-3cdb-4576-a07c-6a49643b8b14 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "POST /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109260 Jul 04 04:22:37.215674 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 404/821] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jul 4 04:22:37 2022] POST /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 04:22:37.273657 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-78d040e9-b7cb-4c52-8ac5-4d9ed12c5164 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:37.274217 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-78d040e9-b7cb-4c52-8ac5-4d9ed12c5164 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:37.280847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-78d040e9-b7cb-4c52-8ac5-4d9ed12c5164 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:37.281353 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-78d040e9-b7cb-4c52-8ac5-4d9ed12c5164 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:37.282120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-78d040e9-b7cb-4c52-8ac5-4d9ed12c5164 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:37.282595 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-78d040e9-b7cb-4c52-8ac5-4d9ed12c5164 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:37.368740 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.objects.instance [None req-78d040e9-b7cb-4c52-8ac5-4d9ed12c5164 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lazy-loading 'services' on Instance uuid 8504f7ec-3a32-4230-ad65-61da993f52bb {{(pid=117875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:22:37.452983 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-78d040e9-b7cb-4c52-8ac5-4d9ed12c5164 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb/os-volume_attachments/d5843607-d7cf-4901-974e-2cc27e698a24" status: 202 len: 0 microversion: 2.1 time: 0.184358 Jul 04 04:22:37.453604 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 418/822] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jul 4 04:22:37 2022] DELETE /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb/os-volume_attachments/d5843607-d7cf-4901-974e-2cc27e698a24 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:22:37.462635 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-314b8f57-6689-4608-bca4-90d0ec5a8854 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:37.463889 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-314b8f57-6689-4608-bca4-90d0ec5a8854 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:37.470199 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-314b8f57-6689-4608-bca4-90d0ec5a8854 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:37.470895 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-314b8f57-6689-4608-bca4-90d0ec5a8854 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:37.471708 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-314b8f57-6689-4608-bca4-90d0ec5a8854 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:37.472301 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-314b8f57-6689-4608-bca4-90d0ec5a8854 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:37.506400 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-314b8f57-6689-4608-bca4-90d0ec5a8854 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048021 Jul 04 04:22:37.506978 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 405/823] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:22:37 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:22:38.519914 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-037b874d-5b9d-4958-8a64-24c22f852006 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:38.521073 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-037b874d-5b9d-4958-8a64-24c22f852006 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:38.528088 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-037b874d-5b9d-4958-8a64-24c22f852006 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:38.528531 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-037b874d-5b9d-4958-8a64-24c22f852006 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:38.529294 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-037b874d-5b9d-4958-8a64-24c22f852006 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:38.529719 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-037b874d-5b9d-4958-8a64-24c22f852006 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:38.558134 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-037b874d-5b9d-4958-8a64-24c22f852006 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043121 Jul 04 04:22:38.558728 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 419/824] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:22:38 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 04:22:38.620079 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fea50cd8-05c7-4a2a-9f6e-69b32d43bf9b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:38.620604 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fea50cd8-05c7-4a2a-9f6e-69b32d43bf9b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:38.627320 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fea50cd8-05c7-4a2a-9f6e-69b32d43bf9b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:38.628294 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fea50cd8-05c7-4a2a-9f6e-69b32d43bf9b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:38.629090 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fea50cd8-05c7-4a2a-9f6e-69b32d43bf9b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:38.629530 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fea50cd8-05c7-4a2a-9f6e-69b32d43bf9b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:38.655478 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fea50cd8-05c7-4a2a-9f6e-69b32d43bf9b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:22:38.736676 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fea50cd8-05c7-4a2a-9f6e-69b32d43bf9b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 204 len: 0 microversion: 2.1 time: 0.120282 Jul 04 04:22:38.737457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 406/825] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:22:38 2022] DELETE /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:22:38.745944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a298db9d-9268-47f6-b260-72a1cce7d685 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:38.746577 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a298db9d-9268-47f6-b260-72a1cce7d685 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:38.753130 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a298db9d-9268-47f6-b260-72a1cce7d685 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:38.753573 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a298db9d-9268-47f6-b260-72a1cce7d685 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:38.754312 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a298db9d-9268-47f6-b260-72a1cce7d685 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:38.754772 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a298db9d-9268-47f6-b260-72a1cce7d685 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:38.895154 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a298db9d-9268-47f6-b260-72a1cce7d685 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:38.903126 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a298db9d-9268-47f6-b260-72a1cce7d685 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 200 len: 1680 microversion: 2.1 time: 0.161001 Jul 04 04:22:38.903692 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 420/826] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:38 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:39.925446 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-523b1968-e313-4c63-b9d9-01c2bdbbca8c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:39.926434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-523b1968-e313-4c63-b9d9-01c2bdbbca8c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:39.937114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-523b1968-e313-4c63-b9d9-01c2bdbbca8c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:39.938053 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-523b1968-e313-4c63-b9d9-01c2bdbbca8c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:39.939290 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-523b1968-e313-4c63-b9d9-01c2bdbbca8c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:39.940168 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-523b1968-e313-4c63-b9d9-01c2bdbbca8c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:40.092850 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-523b1968-e313-4c63-b9d9-01c2bdbbca8c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:40.100888 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-523b1968-e313-4c63-b9d9-01c2bdbbca8c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 200 len: 1680 microversion: 2.1 time: 0.182768 Jul 04 04:22:40.101482 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 407/827] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:39 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:41.118059 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-62777215-2bff-433e-892f-bde9f9caf695 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:41.118685 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-62777215-2bff-433e-892f-bde9f9caf695 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:41.125690 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-62777215-2bff-433e-892f-bde9f9caf695 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:41.126121 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-62777215-2bff-433e-892f-bde9f9caf695 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:41.126990 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-62777215-2bff-433e-892f-bde9f9caf695 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:41.127694 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-62777215-2bff-433e-892f-bde9f9caf695 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:41.257994 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-62777215-2bff-433e-892f-bde9f9caf695 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:41.265872 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-62777215-2bff-433e-892f-bde9f9caf695 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 200 len: 1680 microversion: 2.1 time: 0.151829 Jul 04 04:22:41.266450 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 421/828] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:41 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:41.926644 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-73a04df0-dcc1-472b-8255-69e092169a7e req-c8725203-8fcc-4701-945d-4323f4ef0642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8504f7ec-3a32-4230-ad65-61da993f52bb", "name": "network-vif-deleted", "tag": "7051c212-d0bc-4b65-80eb-a9c6d3fd89c4"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:22:41.937338 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-73a04df0-dcc1-472b-8255-69e092169a7e req-c8725203-8fcc-4701-945d-4323f4ef0642 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:41.937886 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-73a04df0-dcc1-472b-8255-69e092169a7e req-c8725203-8fcc-4701-945d-4323f4ef0642 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:41.951022 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-73a04df0-dcc1-472b-8255-69e092169a7e req-c8725203-8fcc-4701-945d-4323f4ef0642 service nova] Creating event network-vif-deleted:7051c212-d0bc-4b65-80eb-a9c6d3fd89c4 for instance 8504f7ec-3a32-4230-ad65-61da993f52bb on hv-cinder-74216 Jul 04 04:22:41.956947 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-73a04df0-dcc1-472b-8255-69e092169a7e req-c8725203-8fcc-4701-945d-4323f4ef0642 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034556 Jul 04 04:22:41.957714 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 408/829] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:22:42.283595 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-8f8a274d-fb01-43ee-882e-cc75a80372bc tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:42.284193 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-8f8a274d-fb01-43ee-882e-cc75a80372bc tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:42.291117 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8f8a274d-fb01-43ee-882e-cc75a80372bc tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:42.291558 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8f8a274d-fb01-43ee-882e-cc75a80372bc tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:42.292320 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8f8a274d-fb01-43ee-882e-cc75a80372bc tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:42.292919 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8f8a274d-fb01-43ee-882e-cc75a80372bc tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:42.324315 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8f8a274d-fb01-43ee-882e-cc75a80372bc tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:42.324767 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8f8a274d-fb01-43ee-882e-cc75a80372bc tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:42.325258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.objects.instance [None req-8f8a274d-fb01-43ee-882e-cc75a80372bc tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lazy-loading 'fault' on Instance uuid 8504f7ec-3a32-4230-ad65-61da993f52bb {{(pid=117875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:22:42.368461 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-8f8a274d-fb01-43ee-882e-cc75a80372bc tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:42.377912 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-8f8a274d-fb01-43ee-882e-cc75a80372bc tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 200 len: 1329 microversion: 2.1 time: 0.098083 Jul 04 04:22:42.378530 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 422/830] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:42 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 1329 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:43.398951 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8f27b2e8-5a6d-4123-8686-70c19fb78918 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:43.399538 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8f27b2e8-5a6d-4123-8686-70c19fb78918 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:43.406876 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f27b2e8-5a6d-4123-8686-70c19fb78918 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:43.407313 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f27b2e8-5a6d-4123-8686-70c19fb78918 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:43.408721 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f27b2e8-5a6d-4123-8686-70c19fb78918 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:43.408975 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8f27b2e8-5a6d-4123-8686-70c19fb78918 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:43.426537 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-8f27b2e8-5a6d-4123-8686-70c19fb78918 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] HTTP exception thrown: Instance 8504f7ec-3a32-4230-ad65-61da993f52bb could not be found. Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8f27b2e8-5a6d-4123-8686-70c19fb78918 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Request method failure captured: Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb HTTP/1.1 Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmkvvNXviK4RHs-pC2ZUGxhjzRMF8G1iwt3QQvENmXB_WKs6Un0uo-bkU60UeA5mbFaWI8DULlMS96BRMKHcqOYLorEFYdRp34ZJFtZG4dJDmi0fE-jBVj7rCHrbsjhLZ51yhgpFUDC-ASYnpBPbmkcyUWrK8JyNvv4uGci2lLUQkr4 Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:22:43.429259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:22:43.430816 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ccd298eebe6413daaae0d801e902616", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:22:43.430816 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:22:43.430816 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:22:43.430816 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:22:43.430816 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:22:43.430816 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:22:43.430816 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:22:43.430816 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: 4041faa2919d4760ae10907070a10dc7 Jul 04 04:22:43.430816 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:22:43.430816 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:22:43.430816 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance 8504f7ec-3a32-4230-ad65-61da993f52bb could not be found. Jul 04 04:22:43.430816 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': '8504f7ec-3a32-4230-ad65-61da993f52bb'} Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8504f7ec-3a32-4230-ad65-61da993f52bb could not be found. Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:22:43.431685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:22:43.432974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:22:43.432974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:22:43.432974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:22:43.432974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:22:43.432974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:22:43.432974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:22:43.432974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:22:43.432974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8504f7ec-3a32-4230-ad65-61da993f52bb could not be found. Jul 04 04:22:43.432974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:22:43.432974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:22:43.432974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:22:43.432974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:22:43.432974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:22:43.432974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:22:43.432974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:22:43.432974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:22:43.432974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8504f7ec-3a32-4230-ad65-61da993f52bb could not be found. Jul 04 04:22:43.432974 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:22:43.434495 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8f27b2e8-5a6d-4123-8686-70c19fb78918 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Returning 404 to user: Instance 8504f7ec-3a32-4230-ad65-61da993f52bb could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:22:43.434495 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8f27b2e8-5a6d-4123-8686-70c19fb78918 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 404 len: 111 microversion: 2.1 time: 0.038093 Jul 04 04:22:43.435568 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 409/831] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:43 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:22:43.441581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5fd308ce-5563-4e79-bd40-fb82df25e18c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '.version_select at 0x7f50c10f83a0>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:43.462728 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5fd308ce-5563-4e79-bd40-fb82df25e18c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-36021855" status: 202 len: 0 microversion: 2.1 time: 0.025984 Jul 04 04:22:43.463335 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 423/832] 10.222.0.16 () {58 vars in 1214 bytes} [Mon Jul 4 04:22:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-36021855 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 04:22:44.125876 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2e327d53-a0d3-442f-b3c4-4df29e302073 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Action: 'create', calling method: .version_select at 0x7f50c0f39430>, body: {"keypair": {"name": "tempest-keypair-745228610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEyXRj+t+4ttjtfim6rtClU1W6bPzlwRJVBYCD8B3iL9Oe8Ib4iG0XIn1mpwUiFCneRYC5wSKE/NNFN2y5a3UyT/GbWOeoODeiB+C4atewQIHcYDjJVax7shVWqY5RkLQ=="}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:22:44.141459 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-2e327d53-a0d3-442f-b3c4-4df29e302073 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Getting quotas for project 7ccd298eebe6413daaae0d801e902616. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:22:44.145736 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-2e327d53-a0d3-442f-b3c4-4df29e302073 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Getting quotas for user 4041faa2919d4760ae10907070a10dc7 and project 7ccd298eebe6413daaae0d801e902616. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:22:44.171311 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2e327d53-a0d3-442f-b3c4-4df29e302073 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049538 Jul 04 04:22:44.171944 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 410/833] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jul 4 04:22:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:22:45.504399 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-baec7e74-b44d-4bdc-9938-0348e1f4231e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-945609643", "imageRef": "46b9937d-f997-401a-a3aa-bb9028764454", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0e412eaf-c623-4c5a-9f62-8e6b8ef74b11"}], "security_groups": [{"name": "tempest-securitygroup--1454941628"}], "key_name": "tempest-keypair-745228610", "user_data": "}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:22:45.606965 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.network.neutron [None req-baec7e74-b44d-4bdc-9938-0348e1f4231e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] validate_networks() for [('0e412eaf-c623-4c5a-9f62-8e6b8ef74b11', None, None, None, None, None)] {{(pid=117875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:22:45.988932 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-baec7e74-b44d-4bdc-9938-0348e1f4231e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Flavor limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:22:45.989347 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-baec7e74-b44d-4bdc-9938-0348e1f4231e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Image limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:22:45.989820 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-baec7e74-b44d-4bdc-9938-0348e1f4231e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Flavor pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:22:45.990215 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-baec7e74-b44d-4bdc-9938-0348e1f4231e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Image pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:22:45.990627 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-baec7e74-b44d-4bdc-9938-0348e1f4231e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:22:45.999602 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-baec7e74-b44d-4bdc-9938-0348e1f4231e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:46.000044 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-baec7e74-b44d-4bdc-9938-0348e1f4231e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:46.000833 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-baec7e74-b44d-4bdc-9938-0348e1f4231e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:46.001272 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-baec7e74-b44d-4bdc-9938-0348e1f4231e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:46.018279 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-baec7e74-b44d-4bdc-9938-0348e1f4231e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Getting quotas for project 7ccd298eebe6413daaae0d801e902616. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:22:46.022216 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-baec7e74-b44d-4bdc-9938-0348e1f4231e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Getting quotas for user 4041faa2919d4760ae10907070a10dc7 and project 7ccd298eebe6413daaae0d801e902616. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:22:46.033073 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-baec7e74-b44d-4bdc-9938-0348e1f4231e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Going to run 1 instances... {{(pid=117875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:22:46.035510 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-baec7e74-b44d-4bdc-9938-0348e1f4231e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46b9937d-f997-401a-a3aa-bb9028764454',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:22:46.085580 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-baec7e74-b44d-4bdc-9938-0348e1f4231e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.586023 Jul 04 04:22:46.086248 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 424/834] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:22:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 04:22:46.104525 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b4ad4ae8-e9c5-463b-b74d-816768820b10 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:46.105213 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b4ad4ae8-e9c5-463b-b74d-816768820b10 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:46.164875 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b4ad4ae8-e9c5-463b-b74d-816768820b10 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:46.171668 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b4ad4ae8-e9c5-463b-b74d-816768820b10 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd" status: 200 len: 1240 microversion: 2.1 time: 0.071716 Jul 04 04:22:46.172263 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 411/835] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:46 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:47.189976 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-038a8aea-2a75-4ca2-a417-4d4ff8a8d8b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:47.190626 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-038a8aea-2a75-4ca2-a417-4d4ff8a8d8b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:47.197669 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-038a8aea-2a75-4ca2-a417-4d4ff8a8d8b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:47.198465 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-038a8aea-2a75-4ca2-a417-4d4ff8a8d8b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:47.199459 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-038a8aea-2a75-4ca2-a417-4d4ff8a8d8b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:47.200066 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-038a8aea-2a75-4ca2-a417-4d4ff8a8d8b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:47.267502 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-038a8aea-2a75-4ca2-a417-4d4ff8a8d8b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:47.275897 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-038a8aea-2a75-4ca2-a417-4d4ff8a8d8b4 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd" status: 200 len: 1310 microversion: 2.1 time: 0.090603 Jul 04 04:22:47.276637 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 425/836] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:47 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd => generated 1310 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:48.293756 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-402f02bd-5f95-4c98-9ca5-1424c531ac03 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:48.294348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-402f02bd-5f95-4c98-9ca5-1424c531ac03 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:48.301699 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-402f02bd-5f95-4c98-9ca5-1424c531ac03 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:48.302144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-402f02bd-5f95-4c98-9ca5-1424c531ac03 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:48.302952 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-402f02bd-5f95-4c98-9ca5-1424c531ac03 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:48.303379 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-402f02bd-5f95-4c98-9ca5-1424c531ac03 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:48.530858 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-402f02bd-5f95-4c98-9ca5-1424c531ac03 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:48.539066 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-402f02bd-5f95-4c98-9ca5-1424c531ac03 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd" status: 200 len: 1366 microversion: 2.1 time: 0.249781 Jul 04 04:22:48.539647 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 412/837] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:48 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:48.756039 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-f38a17d3-b4eb-4484-aaa9-bc96fbccd9f3 req-eea8694e-c6d3-437a-864f-e5d9227055df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd", "tag": "bca976de-c3c2-454d-b790-aaeab20af040"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:22:48.769456 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-f38a17d3-b4eb-4484-aaa9-bc96fbccd9f3 req-eea8694e-c6d3-437a-864f-e5d9227055df service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:48.770013 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-f38a17d3-b4eb-4484-aaa9-bc96fbccd9f3 req-eea8694e-c6d3-437a-864f-e5d9227055df service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:48.784469 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-f38a17d3-b4eb-4484-aaa9-bc96fbccd9f3 req-eea8694e-c6d3-437a-864f-e5d9227055df service nova] Creating event network-changed:bca976de-c3c2-454d-b790-aaeab20af040 for instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd on hv-cinder-74216 Jul 04 04:22:48.790077 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-f38a17d3-b4eb-4484-aaa9-bc96fbccd9f3 req-eea8694e-c6d3-437a-864f-e5d9227055df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039828 Jul 04 04:22:48.790727 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 426/838] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:22:49.556602 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d0fba3e3-8807-4909-a78d-4ff8fd09d345 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:49.557222 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d0fba3e3-8807-4909-a78d-4ff8fd09d345 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:49.564414 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d0fba3e3-8807-4909-a78d-4ff8fd09d345 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:49.564866 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d0fba3e3-8807-4909-a78d-4ff8fd09d345 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:49.565771 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d0fba3e3-8807-4909-a78d-4ff8fd09d345 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:49.566241 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d0fba3e3-8807-4909-a78d-4ff8fd09d345 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:49.708075 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d0fba3e3-8807-4909-a78d-4ff8fd09d345 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:49.719990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d0fba3e3-8807-4909-a78d-4ff8fd09d345 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd" status: 200 len: 1366 microversion: 2.1 time: 0.167091 Jul 04 04:22:49.720728 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 413/839] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:49 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:50.739856 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d6829674-58b8-4b9a-a298-f3b94499a883 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:50.740546 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d6829674-58b8-4b9a-a298-f3b94499a883 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:50.748157 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d6829674-58b8-4b9a-a298-f3b94499a883 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:50.748601 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d6829674-58b8-4b9a-a298-f3b94499a883 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:50.749372 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d6829674-58b8-4b9a-a298-f3b94499a883 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:50.749798 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d6829674-58b8-4b9a-a298-f3b94499a883 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:50.903489 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d6829674-58b8-4b9a-a298-f3b94499a883 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:50.912006 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d6829674-58b8-4b9a-a298-f3b94499a883 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd" status: 200 len: 1366 microversion: 2.1 time: 0.177720 Jul 04 04:22:50.912566 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 427/840] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:50 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:51.933506 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-329a661e-02e0-44d8-8a85-fb36ce4d1f65 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:51.934322 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-329a661e-02e0-44d8-8a85-fb36ce4d1f65 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:51.941408 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-329a661e-02e0-44d8-8a85-fb36ce4d1f65 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:51.941860 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-329a661e-02e0-44d8-8a85-fb36ce4d1f65 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:51.942661 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-329a661e-02e0-44d8-8a85-fb36ce4d1f65 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:51.943092 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-329a661e-02e0-44d8-8a85-fb36ce4d1f65 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:52.081344 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-329a661e-02e0-44d8-8a85-fb36ce4d1f65 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:52.088996 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-329a661e-02e0-44d8-8a85-fb36ce4d1f65 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd" status: 200 len: 1366 microversion: 2.1 time: 0.159486 Jul 04 04:22:52.089565 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 414/841] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:51 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:53.112244 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e3eeb95a-be70-408f-b347-ea9ca034cb63 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:53.112852 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e3eeb95a-be70-408f-b347-ea9ca034cb63 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:53.119754 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e3eeb95a-be70-408f-b347-ea9ca034cb63 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:53.120196 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e3eeb95a-be70-408f-b347-ea9ca034cb63 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:53.120952 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e3eeb95a-be70-408f-b347-ea9ca034cb63 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:53.121378 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e3eeb95a-be70-408f-b347-ea9ca034cb63 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:53.255489 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e3eeb95a-be70-408f-b347-ea9ca034cb63 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:53.263707 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e3eeb95a-be70-408f-b347-ea9ca034cb63 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd" status: 200 len: 1366 microversion: 2.1 time: 0.155397 Jul 04 04:22:53.264261 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 428/842] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:53 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:54.285363 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eeca24dd-0fdc-4074-a243-be0d6df2657b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:54.286472 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eeca24dd-0fdc-4074-a243-be0d6df2657b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:54.297629 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eeca24dd-0fdc-4074-a243-be0d6df2657b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:54.298414 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eeca24dd-0fdc-4074-a243-be0d6df2657b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:54.299684 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eeca24dd-0fdc-4074-a243-be0d6df2657b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:54.300472 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eeca24dd-0fdc-4074-a243-be0d6df2657b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:54.438078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eeca24dd-0fdc-4074-a243-be0d6df2657b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:54.446471 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eeca24dd-0fdc-4074-a243-be0d6df2657b tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd" status: 200 len: 1366 microversion: 2.1 time: 0.167795 Jul 04 04:22:54.447055 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 415/843] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:54 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:54.992854 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-983b66eb-0d66-4ed0-9c76-4df4529081be req-d379e611-db7d-4ad1-a485-2aaae4301c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd", "name": "network-vif-plugged", "status": "completed", "tag": "bca976de-c3c2-454d-b790-aaeab20af040"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:22:55.002303 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-983b66eb-0d66-4ed0-9c76-4df4529081be req-d379e611-db7d-4ad1-a485-2aaae4301c86 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:55.002731 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-983b66eb-0d66-4ed0-9c76-4df4529081be req-d379e611-db7d-4ad1-a485-2aaae4301c86 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:55.015330 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-983b66eb-0d66-4ed0-9c76-4df4529081be req-d379e611-db7d-4ad1-a485-2aaae4301c86 service nova] Creating event network-vif-plugged:bca976de-c3c2-454d-b790-aaeab20af040 for instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd on hv-cinder-74216 Jul 04 04:22:55.021024 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-983b66eb-0d66-4ed0-9c76-4df4529081be req-d379e611-db7d-4ad1-a485-2aaae4301c86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031524 Jul 04 04:22:55.022311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 429/844] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:22:55.470364 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a08e4bcd-11b6-4bd3-bb4e-ca08d49b3d97 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:55.471407 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a08e4bcd-11b6-4bd3-bb4e-ca08d49b3d97 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:55.479168 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a08e4bcd-11b6-4bd3-bb4e-ca08d49b3d97 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:55.479615 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a08e4bcd-11b6-4bd3-bb4e-ca08d49b3d97 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:55.480384 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a08e4bcd-11b6-4bd3-bb4e-ca08d49b3d97 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:55.480815 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a08e4bcd-11b6-4bd3-bb4e-ca08d49b3d97 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:55.615486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a08e4bcd-11b6-4bd3-bb4e-ca08d49b3d97 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:55.623084 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a08e4bcd-11b6-4bd3-bb4e-ca08d49b3d97 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd" status: 200 len: 1366 microversion: 2.1 time: 0.159307 Jul 04 04:22:55.623656 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 416/845] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:55 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:56.645330 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7d34b6bb-01f8-4314-b1cd-e899acb2736d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:56.646026 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7d34b6bb-01f8-4314-b1cd-e899acb2736d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:56.648508 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=2 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:22:56.649191 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=6 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:22:56.655056 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7d34b6bb-01f8-4314-b1cd-e899acb2736d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:56.655495 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7d34b6bb-01f8-4314-b1cd-e899acb2736d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:56.656495 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7d34b6bb-01f8-4314-b1cd-e899acb2736d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:56.656927 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7d34b6bb-01f8-4314-b1cd-e899acb2736d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:56.805867 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7d34b6bb-01f8-4314-b1cd-e899acb2736d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:56.813940 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7d34b6bb-01f8-4314-b1cd-e899acb2736d tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd" status: 200 len: 1366 microversion: 2.1 time: 0.174984 Jul 04 04:22:56.814616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 430/846] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:56 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:57.835299 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3e87c128-d929-4d90-b515-0b4574f5a5fd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:57.836265 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3e87c128-d929-4d90-b515-0b4574f5a5fd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:57.839418 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=6 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:22:57.849367 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e87c128-d929-4d90-b515-0b4574f5a5fd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:57.849810 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e87c128-d929-4d90-b515-0b4574f5a5fd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:57.850614 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e87c128-d929-4d90-b515-0b4574f5a5fd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:57.851045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3e87c128-d929-4d90-b515-0b4574f5a5fd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:57.986616 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3e87c128-d929-4d90-b515-0b4574f5a5fd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:22:57.988888 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:22:57.995680 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3e87c128-d929-4d90-b515-0b4574f5a5fd tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd" status: 200 len: 1556 microversion: 2.1 time: 0.167157 Jul 04 04:22:57.996333 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 417/847] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:22:57 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:22:58.015193 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3ecd44e7-1a64-4de3-ba23-137f601f1323 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:22:58.016007 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-3ecd44e7-1a64-4de3-ba23-137f601f1323 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:22:58.024812 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3ecd44e7-1a64-4de3-ba23-137f601f1323 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:58.025257 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3ecd44e7-1a64-4de3-ba23-137f601f1323 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:58.026021 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3ecd44e7-1a64-4de3-ba23-137f601f1323 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:58.026480 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3ecd44e7-1a64-4de3-ba23-137f601f1323 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:58.105246 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3ecd44e7-1a64-4de3-ba23-137f601f1323 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096471 Jul 04 04:22:58.105930 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 431/848] 10.222.0.16 () {58 vars in 1274 bytes} [Mon Jul 4 04:22:58 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:22:59.069898 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-f214bb87-594e-4238-9472-f89457ebac20 req-abe3c033-60d9-4d43-908f-d601704dd739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd", "tag": "bca976de-c3c2-454d-b790-aaeab20af040"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:22:59.073384 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:22:59.080273 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-f214bb87-594e-4238-9472-f89457ebac20 req-abe3c033-60d9-4d43-908f-d601704dd739 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:22:59.080673 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-f214bb87-594e-4238-9472-f89457ebac20 req-abe3c033-60d9-4d43-908f-d601704dd739 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:22:59.093509 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-f214bb87-594e-4238-9472-f89457ebac20 req-abe3c033-60d9-4d43-908f-d601704dd739 service nova] Creating event network-changed:bca976de-c3c2-454d-b790-aaeab20af040 for instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd on hv-cinder-74216 Jul 04 04:22:59.098675 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-f214bb87-594e-4238-9472-f89457ebac20 req-abe3c033-60d9-4d43-908f-d601704dd739 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033632 Jul 04 04:22:59.099326 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 418/849] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:23:17.798689 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:23:17.799702 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:23:17.917188 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-76a8b7aa-d119-45ca-9de1-97556215cce4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:17.917685 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-76a8b7aa-d119-45ca-9de1-97556215cce4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:17.924525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-76a8b7aa-d119-45ca-9de1-97556215cce4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:17.924963 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-76a8b7aa-d119-45ca-9de1-97556215cce4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:17.925723 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-76a8b7aa-d119-45ca-9de1-97556215cce4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:17.926148 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-76a8b7aa-d119-45ca-9de1-97556215cce4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:17.949850 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-76a8b7aa-d119-45ca-9de1-97556215cce4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1/ips" status: 200 len: 152 microversion: 2.20 time: 0.153387 Jul 04 04:23:17.950403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 432/850] 10.222.0.16 () {60 vars in 1288 bytes} [Mon Jul 4 04:23:17 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1/ips => generated 152 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 04:23:20.013038 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:23:20.016709 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:23:20.019497 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0988074d-5454-40d6-9a08-390ebdbc8fde tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:23:20.020110 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0988074d-5454-40d6-9a08-390ebdbc8fde tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:20.027571 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0988074d-5454-40d6-9a08-390ebdbc8fde tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:20.028013 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0988074d-5454-40d6-9a08-390ebdbc8fde tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:20.028786 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0988074d-5454-40d6-9a08-390ebdbc8fde tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:20.029246 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0988074d-5454-40d6-9a08-390ebdbc8fde tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:20.054090 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-0988074d-5454-40d6-9a08-390ebdbc8fde tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lazy-loading 'flavor' on Instance uuid fb99d59a-d33a-48d2-9824-25f44c1f32c1 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:23:20.323273 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0988074d-5454-40d6-9a08-390ebdbc8fde tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "POST /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1/action" status: 202 len: 0 microversion: 2.20 time: 0.313104 Jul 04 04:23:20.324023 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 419/851] 10.222.0.16 () {62 vars in 1318 bytes} [Mon Jul 4 04:23:20 2022] POST /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:23:20.336569 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a7040c72-5cab-4820-8ab0-212f6ef35c9c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:20.337199 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a7040c72-5cab-4820-8ab0-212f6ef35c9c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:20.345824 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a7040c72-5cab-4820-8ab0-212f6ef35c9c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:20.346283 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a7040c72-5cab-4820-8ab0-212f6ef35c9c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:20.347096 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a7040c72-5cab-4820-8ab0-212f6ef35c9c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:20.347560 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a7040c72-5cab-4820-8ab0-212f6ef35c9c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:20.489948 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a7040c72-5cab-4820-8ab0-212f6ef35c9c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:20.497901 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a7040c72-5cab-4820-8ab0-212f6ef35c9c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:20.499399 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a7040c72-5cab-4820-8ab0-212f6ef35c9c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:20.500591 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a7040c72-5cab-4820-8ab0-212f6ef35c9c tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1725 microversion: 2.20 time: 0.170068 Jul 04 04:23:20.501150 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 433/852] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:20 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:21.527030 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-33747584-d497-4fe1-a9c2-c03ddf1bed11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:21.528159 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-33747584-d497-4fe1-a9c2-c03ddf1bed11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:21.538853 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33747584-d497-4fe1-a9c2-c03ddf1bed11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:21.539600 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33747584-d497-4fe1-a9c2-c03ddf1bed11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:21.540890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33747584-d497-4fe1-a9c2-c03ddf1bed11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:21.541625 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33747584-d497-4fe1-a9c2-c03ddf1bed11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:21.684187 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-33747584-d497-4fe1-a9c2-c03ddf1bed11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:21.692476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-33747584-d497-4fe1-a9c2-c03ddf1bed11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:21.693959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-33747584-d497-4fe1-a9c2-c03ddf1bed11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:21.695155 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-33747584-d497-4fe1-a9c2-c03ddf1bed11 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1725 microversion: 2.20 time: 0.176162 Jul 04 04:23:21.695735 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 420/853] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:21 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:22.717825 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-fccf804c-f9dd-4fe4-8070-310cfa197882 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:22.719128 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-fccf804c-f9dd-4fe4-8070-310cfa197882 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:22.729489 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fccf804c-f9dd-4fe4-8070-310cfa197882 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:22.730253 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fccf804c-f9dd-4fe4-8070-310cfa197882 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:22.731557 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fccf804c-f9dd-4fe4-8070-310cfa197882 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:22.732269 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fccf804c-f9dd-4fe4-8070-310cfa197882 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:22.872858 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-fccf804c-f9dd-4fe4-8070-310cfa197882 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:22.881721 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-fccf804c-f9dd-4fe4-8070-310cfa197882 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:22.883395 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-fccf804c-f9dd-4fe4-8070-310cfa197882 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:22.884643 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-fccf804c-f9dd-4fe4-8070-310cfa197882 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1725 microversion: 2.20 time: 0.174155 Jul 04 04:23:22.886497 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 434/854] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:22 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:23.907299 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6c1060de-f8e8-4355-8ce0-1d740bcbc163 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:23.908273 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6c1060de-f8e8-4355-8ce0-1d740bcbc163 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:23.915722 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c1060de-f8e8-4355-8ce0-1d740bcbc163 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:23.916188 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c1060de-f8e8-4355-8ce0-1d740bcbc163 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:23.916993 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c1060de-f8e8-4355-8ce0-1d740bcbc163 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:23.917441 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c1060de-f8e8-4355-8ce0-1d740bcbc163 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:24.081092 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6c1060de-f8e8-4355-8ce0-1d740bcbc163 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:24.089748 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6c1060de-f8e8-4355-8ce0-1d740bcbc163 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:24.091283 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6c1060de-f8e8-4355-8ce0-1d740bcbc163 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:24.092461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6c1060de-f8e8-4355-8ce0-1d740bcbc163 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1725 microversion: 2.20 time: 0.191928 Jul 04 04:23:24.093036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 421/855] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:23 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:25.115879 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a82d1ce8-1dff-4e97-806a-e7d5ecf26edb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:25.116618 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a82d1ce8-1dff-4e97-806a-e7d5ecf26edb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:25.125580 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a82d1ce8-1dff-4e97-806a-e7d5ecf26edb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:25.126162 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a82d1ce8-1dff-4e97-806a-e7d5ecf26edb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:25.127939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a82d1ce8-1dff-4e97-806a-e7d5ecf26edb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:25.128510 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a82d1ce8-1dff-4e97-806a-e7d5ecf26edb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:25.269246 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a82d1ce8-1dff-4e97-806a-e7d5ecf26edb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:25.277609 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a82d1ce8-1dff-4e97-806a-e7d5ecf26edb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:25.279109 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a82d1ce8-1dff-4e97-806a-e7d5ecf26edb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:25.280254 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a82d1ce8-1dff-4e97-806a-e7d5ecf26edb tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1725 microversion: 2.20 time: 0.171245 Jul 04 04:23:25.280815 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 435/856] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:25 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:26.276400 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-16e733c0-d2f1-4ec7-abd6-61871cc00c79 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:26.277273 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-16e733c0-d2f1-4ec7-abd6-61871cc00c79 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:26.286319 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16e733c0-d2f1-4ec7-abd6-61871cc00c79 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:26.286795 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16e733c0-d2f1-4ec7-abd6-61871cc00c79 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:26.287562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16e733c0-d2f1-4ec7-abd6-61871cc00c79 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:26.287994 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16e733c0-d2f1-4ec7-abd6-61871cc00c79 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:26.299723 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-32c98fe0-dd37-4fba-8ef2-18f050a886e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:26.300332 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-32c98fe0-dd37-4fba-8ef2-18f050a886e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:26.307499 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-32c98fe0-dd37-4fba-8ef2-18f050a886e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:26.307940 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-32c98fe0-dd37-4fba-8ef2-18f050a886e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:26.308690 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-32c98fe0-dd37-4fba-8ef2-18f050a886e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:26.309114 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-32c98fe0-dd37-4fba-8ef2-18f050a886e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:26.311453 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-16e733c0-d2f1-4ec7-abd6-61871cc00c79 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296/ips" status: 200 len: 146 microversion: 2.1 time: 0.041590 Jul 04 04:23:26.312025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 422/857] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jul 4 04:23:26 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:23:26.444777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-32c98fe0-dd37-4fba-8ef2-18f050a886e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:26.456235 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-32c98fe0-dd37-4fba-8ef2-18f050a886e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:26.457709 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-32c98fe0-dd37-4fba-8ef2-18f050a886e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:26.458893 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-32c98fe0-dd37-4fba-8ef2-18f050a886e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1725 microversion: 2.20 time: 0.163443 Jul 04 04:23:26.459427 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 436/858] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:26 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:27.481649 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d7c5ca5e-7721-44e6-aef4-d1498a1ede15 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:27.482661 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d7c5ca5e-7721-44e6-aef4-d1498a1ede15 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:27.491317 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d7c5ca5e-7721-44e6-aef4-d1498a1ede15 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:27.491764 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d7c5ca5e-7721-44e6-aef4-d1498a1ede15 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:27.492519 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d7c5ca5e-7721-44e6-aef4-d1498a1ede15 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:27.492951 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d7c5ca5e-7721-44e6-aef4-d1498a1ede15 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:27.636496 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d7c5ca5e-7721-44e6-aef4-d1498a1ede15 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:27.644742 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d7c5ca5e-7721-44e6-aef4-d1498a1ede15 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:27.646238 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d7c5ca5e-7721-44e6-aef4-d1498a1ede15 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:27.647434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d7c5ca5e-7721-44e6-aef4-d1498a1ede15 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1725 microversion: 2.20 time: 0.172312 Jul 04 04:23:27.647962 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 423/859] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:27 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:28.669703 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e7273140-72db-458a-bbab-8048a613d206 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:28.670743 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e7273140-72db-458a-bbab-8048a613d206 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:28.682413 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7273140-72db-458a-bbab-8048a613d206 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:28.683197 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7273140-72db-458a-bbab-8048a613d206 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:28.684561 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7273140-72db-458a-bbab-8048a613d206 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:28.685284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7273140-72db-458a-bbab-8048a613d206 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:28.822352 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e7273140-72db-458a-bbab-8048a613d206 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:28.830421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e7273140-72db-458a-bbab-8048a613d206 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:28.831905 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e7273140-72db-458a-bbab-8048a613d206 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:28.833219 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e7273140-72db-458a-bbab-8048a613d206 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1725 microversion: 2.20 time: 0.170042 Jul 04 04:23:28.833763 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 437/860] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:28 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:29.217760 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-15df41be-6cec-46f0-8555-6aa8aa053423 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b06bf946-c7f9-4118-9a6d-61be85612252"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:23:29.218907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-15df41be-6cec-46f0-8555-6aa8aa053423 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:29.225462 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15df41be-6cec-46f0-8555-6aa8aa053423 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:29.225909 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15df41be-6cec-46f0-8555-6aa8aa053423 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:29.226732 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15df41be-6cec-46f0-8555-6aa8aa053423 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:29.227157 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-15df41be-6cec-46f0-8555-6aa8aa053423 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:29.500706 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-15df41be-6cec-46f0-8555-6aa8aa053423 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "POST /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286889 Jul 04 04:23:29.501326 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 424/861] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jul 4 04:23:29 2022] POST /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:23:29.855675 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a5a2f5b9-7c50-4d1d-a43b-f6124d8e341a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:29.856656 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a5a2f5b9-7c50-4d1d-a43b-f6124d8e341a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:29.866076 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a5a2f5b9-7c50-4d1d-a43b-f6124d8e341a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:29.866555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a5a2f5b9-7c50-4d1d-a43b-f6124d8e341a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:29.867345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a5a2f5b9-7c50-4d1d-a43b-f6124d8e341a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:29.867776 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a5a2f5b9-7c50-4d1d-a43b-f6124d8e341a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:29.997358 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a5a2f5b9-7c50-4d1d-a43b-f6124d8e341a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:30.005375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a5a2f5b9-7c50-4d1d-a43b-f6124d8e341a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:30.006874 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a5a2f5b9-7c50-4d1d-a43b-f6124d8e341a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:30.008022 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a5a2f5b9-7c50-4d1d-a43b-f6124d8e341a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1725 microversion: 2.20 time: 0.159056 Jul 04 04:23:30.008558 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 438/862] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:29 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:31.033177 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1e812cac-658b-42fc-a22d-ca5a1dad189b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:31.033881 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1e812cac-658b-42fc-a22d-ca5a1dad189b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:31.040863 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e812cac-658b-42fc-a22d-ca5a1dad189b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:31.041309 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e812cac-658b-42fc-a22d-ca5a1dad189b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:31.042060 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e812cac-658b-42fc-a22d-ca5a1dad189b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:31.042577 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e812cac-658b-42fc-a22d-ca5a1dad189b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:31.189784 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1e812cac-658b-42fc-a22d-ca5a1dad189b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:31.198134 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1e812cac-658b-42fc-a22d-ca5a1dad189b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:31.199644 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1e812cac-658b-42fc-a22d-ca5a1dad189b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:31.200986 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1e812cac-658b-42fc-a22d-ca5a1dad189b tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1725 microversion: 2.20 time: 0.172679 Jul 04 04:23:31.201563 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 425/863] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:31 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:32.224457 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-43b157dd-f7e5-4fb9-8b02-65bad0fee7aa tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:32.225391 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-43b157dd-f7e5-4fb9-8b02-65bad0fee7aa tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:32.236642 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-43b157dd-f7e5-4fb9-8b02-65bad0fee7aa tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:32.237385 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-43b157dd-f7e5-4fb9-8b02-65bad0fee7aa tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:32.238840 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-43b157dd-f7e5-4fb9-8b02-65bad0fee7aa tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:32.239421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-43b157dd-f7e5-4fb9-8b02-65bad0fee7aa tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:32.381447 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-43b157dd-f7e5-4fb9-8b02-65bad0fee7aa tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:32.390089 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-43b157dd-f7e5-4fb9-8b02-65bad0fee7aa tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:32.391656 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-43b157dd-f7e5-4fb9-8b02-65bad0fee7aa tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:32.392812 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-43b157dd-f7e5-4fb9-8b02-65bad0fee7aa tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1725 microversion: 2.20 time: 0.175534 Jul 04 04:23:32.393419 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 439/864] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:32 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:33.414168 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-333a9dff-ab01-4347-90f3-48007dd3b03f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:33.414870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-333a9dff-ab01-4347-90f3-48007dd3b03f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:33.422863 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-333a9dff-ab01-4347-90f3-48007dd3b03f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:33.423355 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-333a9dff-ab01-4347-90f3-48007dd3b03f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:33.424199 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-333a9dff-ab01-4347-90f3-48007dd3b03f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:33.424667 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-333a9dff-ab01-4347-90f3-48007dd3b03f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:33.567810 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-333a9dff-ab01-4347-90f3-48007dd3b03f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:33.576392 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-333a9dff-ab01-4347-90f3-48007dd3b03f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:33.577844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-333a9dff-ab01-4347-90f3-48007dd3b03f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:33.579063 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-333a9dff-ab01-4347-90f3-48007dd3b03f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1725 microversion: 2.20 time: 0.170282 Jul 04 04:23:33.579621 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 426/865] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:33 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:34.601426 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-584e9cb0-c5dd-4697-807f-26daebae4d56 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:34.602408 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-584e9cb0-c5dd-4697-807f-26daebae4d56 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:34.613505 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-584e9cb0-c5dd-4697-807f-26daebae4d56 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:34.614080 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-584e9cb0-c5dd-4697-807f-26daebae4d56 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:34.614887 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-584e9cb0-c5dd-4697-807f-26daebae4d56 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:34.615316 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-584e9cb0-c5dd-4697-807f-26daebae4d56 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:34.753063 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-584e9cb0-c5dd-4697-807f-26daebae4d56 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:34.762016 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-584e9cb0-c5dd-4697-807f-26daebae4d56 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:34.763525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-584e9cb0-c5dd-4697-807f-26daebae4d56 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:34.764698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-584e9cb0-c5dd-4697-807f-26daebae4d56 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1725 microversion: 2.20 time: 0.169945 Jul 04 04:23:34.765265 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 440/866] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:34 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:35.787807 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-11940942-c696-4d1a-857b-d55ce786672f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:35.788826 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-11940942-c696-4d1a-857b-d55ce786672f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:35.800361 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11940942-c696-4d1a-857b-d55ce786672f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:35.801301 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11940942-c696-4d1a-857b-d55ce786672f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:35.802077 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11940942-c696-4d1a-857b-d55ce786672f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:35.802569 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11940942-c696-4d1a-857b-d55ce786672f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:35.945368 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-11940942-c696-4d1a-857b-d55ce786672f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:35.953587 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-11940942-c696-4d1a-857b-d55ce786672f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:35.955202 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-11940942-c696-4d1a-857b-d55ce786672f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:35.956378 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-11940942-c696-4d1a-857b-d55ce786672f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1725 microversion: 2.20 time: 0.175966 Jul 04 04:23:35.957260 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 427/867] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:35 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:36.975230 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-fb98782a-d30b-466f-ad93-39cb3c185eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:36.975908 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-fb98782a-d30b-466f-ad93-39cb3c185eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:36.982837 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fb98782a-d30b-466f-ad93-39cb3c185eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:36.983286 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fb98782a-d30b-466f-ad93-39cb3c185eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:36.984044 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fb98782a-d30b-466f-ad93-39cb3c185eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:36.984529 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fb98782a-d30b-466f-ad93-39cb3c185eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:37.038554 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cf4c42b1-c1f7-4064-9563-6de42487926a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:23:37.045728 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf4c42b1-c1f7-4064-9563-6de42487926a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:37.046185 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf4c42b1-c1f7-4064-9563-6de42487926a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:37.105653 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cf4c42b1-c1f7-4064-9563-6de42487926a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Going to try to stop instance {{(pid=117877) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 04 04:23:37.115480 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-fb98782a-d30b-466f-ad93-39cb3c185eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:37.124081 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-fb98782a-d30b-466f-ad93-39cb3c185eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:37.125563 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-fb98782a-d30b-466f-ad93-39cb3c185eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:37.126749 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-fb98782a-d30b-466f-ad93-39cb3c185eec tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1725 microversion: 2.20 time: 0.155637 Jul 04 04:23:37.127292 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 441/868] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:36 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:37.151438 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cf4c42b1-c1f7-4064-9563-6de42487926a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "POST /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296/action" status: 202 len: 0 microversion: 2.1 time: 0.117043 Jul 04 04:23:37.152094 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 428/869] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 4 04:23:37 2022] POST /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:23:37.160107 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-604e33fa-2373-414a-ac35-28d096932c63 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:37.160716 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-604e33fa-2373-414a-ac35-28d096932c63 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:37.167000 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-604e33fa-2373-414a-ac35-28d096932c63 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:37.167444 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-604e33fa-2373-414a-ac35-28d096932c63 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:37.168233 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-604e33fa-2373-414a-ac35-28d096932c63 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:37.168667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-604e33fa-2373-414a-ac35-28d096932c63 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:37.309938 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-604e33fa-2373-414a-ac35-28d096932c63 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:37.319148 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-604e33fa-2373-414a-ac35-28d096932c63 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1723 microversion: 2.1 time: 0.162105 Jul 04 04:23:37.319766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 442/870] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:23:37 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:23:38.150128 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-05a66c08-5427-452e-a7bc-1a0d8ede44e8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:38.151031 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-05a66c08-5427-452e-a7bc-1a0d8ede44e8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:38.159642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05a66c08-5427-452e-a7bc-1a0d8ede44e8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:38.160195 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05a66c08-5427-452e-a7bc-1a0d8ede44e8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:38.161139 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05a66c08-5427-452e-a7bc-1a0d8ede44e8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:38.161683 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-05a66c08-5427-452e-a7bc-1a0d8ede44e8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:38.298213 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-05a66c08-5427-452e-a7bc-1a0d8ede44e8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:38.307898 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-05a66c08-5427-452e-a7bc-1a0d8ede44e8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:38.309371 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-05a66c08-5427-452e-a7bc-1a0d8ede44e8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:38.310562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-05a66c08-5427-452e-a7bc-1a0d8ede44e8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1746 microversion: 2.20 time: 0.167140 Jul 04 04:23:38.311129 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 429/871] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:38 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:38.337324 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3de8594c-7544-47da-99a1-bcd9ef61c504 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:38.337906 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-3de8594c-7544-47da-99a1-bcd9ef61c504 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:38.344812 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3de8594c-7544-47da-99a1-bcd9ef61c504 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:38.345258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3de8594c-7544-47da-99a1-bcd9ef61c504 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:38.346020 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3de8594c-7544-47da-99a1-bcd9ef61c504 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:38.346479 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3de8594c-7544-47da-99a1-bcd9ef61c504 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:38.480501 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-3de8594c-7544-47da-99a1-bcd9ef61c504 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:38.488749 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3de8594c-7544-47da-99a1-bcd9ef61c504 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1723 microversion: 2.1 time: 0.155545 Jul 04 04:23:38.489321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 443/872] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:23:38 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:23:39.341218 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bde886db-d657-4a8d-a690-61e6b5b43720 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:39.342484 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bde886db-d657-4a8d-a690-61e6b5b43720 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:39.352766 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bde886db-d657-4a8d-a690-61e6b5b43720 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:39.353108 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bde886db-d657-4a8d-a690-61e6b5b43720 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:39.353895 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bde886db-d657-4a8d-a690-61e6b5b43720 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:39.354327 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bde886db-d657-4a8d-a690-61e6b5b43720 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:39.495423 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bde886db-d657-4a8d-a690-61e6b5b43720 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:39.505052 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bde886db-d657-4a8d-a690-61e6b5b43720 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:39.506085 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f06ea8ba-c1e0-47b3-b1ee-2564be130e4b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:39.506802 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f06ea8ba-c1e0-47b3-b1ee-2564be130e4b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:39.506939 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bde886db-d657-4a8d-a690-61e6b5b43720 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:39.508377 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bde886db-d657-4a8d-a690-61e6b5b43720 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1746 microversion: 2.20 time: 0.174277 Jul 04 04:23:39.509017 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 430/873] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:39 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1746 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:39.514450 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f06ea8ba-c1e0-47b3-b1ee-2564be130e4b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:39.514893 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f06ea8ba-c1e0-47b3-b1ee-2564be130e4b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:39.516171 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f06ea8ba-c1e0-47b3-b1ee-2564be130e4b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:39.516780 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f06ea8ba-c1e0-47b3-b1ee-2564be130e4b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:39.652697 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f06ea8ba-c1e0-47b3-b1ee-2564be130e4b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:39.661426 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-f06ea8ba-c1e0-47b3-b1ee-2564be130e4b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1723 microversion: 2.1 time: 0.159144 Jul 04 04:23:39.662003 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 444/874] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:23:39 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:23:40.529050 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cd9b4b26-ee5d-40d0-98c3-648425fda7d3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:40.529678 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cd9b4b26-ee5d-40d0-98c3-648425fda7d3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:40.535789 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd9b4b26-ee5d-40d0-98c3-648425fda7d3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:40.536233 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd9b4b26-ee5d-40d0-98c3-648425fda7d3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:40.536992 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd9b4b26-ee5d-40d0-98c3-648425fda7d3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:40.537421 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cd9b4b26-ee5d-40d0-98c3-648425fda7d3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:40.679680 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-0c9cca25-0889-4d70-9977-d0374e2f1461 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:40.680344 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-0c9cca25-0889-4d70-9977-d0374e2f1461 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:40.687454 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0c9cca25-0889-4d70-9977-d0374e2f1461 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:40.687905 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0c9cca25-0889-4d70-9977-d0374e2f1461 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:40.688683 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0c9cca25-0889-4d70-9977-d0374e2f1461 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:40.689113 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0c9cca25-0889-4d70-9977-d0374e2f1461 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:40.713324 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:23:40.824500 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-0c9cca25-0889-4d70-9977-d0374e2f1461 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:40.827281 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cd9b4b26-ee5d-40d0-98c3-648425fda7d3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:40.833289 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-0c9cca25-0889-4d70-9977-d0374e2f1461 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1723 microversion: 2.1 time: 0.157861 Jul 04 04:23:40.833867 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 445/875] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:23:40 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:23:40.835297 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cd9b4b26-ee5d-40d0-98c3-648425fda7d3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:40.837338 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cd9b4b26-ee5d-40d0-98c3-648425fda7d3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:40.837951 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cd9b4b26-ee5d-40d0-98c3-648425fda7d3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1746 microversion: 2.20 time: 0.313897 Jul 04 04:23:40.838693 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 431/876] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:40 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1746 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:41.274398 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-23324fee-c125-46ec-aa19-3fe574bd7e18 req-653b59b7-a55f-42e8-b331-e123e028ac0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb99d59a-d33a-48d2-9824-25f44c1f32c1", "name": "network-vif-plugged", "status": "completed", "tag": "f6b7b5f9-dfd8-4f10-99f9-c155d967e2de"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:23:41.283428 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-23324fee-c125-46ec-aa19-3fe574bd7e18 req-653b59b7-a55f-42e8-b331-e123e028ac0d service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:41.284013 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-23324fee-c125-46ec-aa19-3fe574bd7e18 req-653b59b7-a55f-42e8-b331-e123e028ac0d service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:41.296403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-23324fee-c125-46ec-aa19-3fe574bd7e18 req-653b59b7-a55f-42e8-b331-e123e028ac0d service nova] Creating event network-vif-plugged:f6b7b5f9-dfd8-4f10-99f9-c155d967e2de for instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 on hv-cinder-74216 Jul 04 04:23:41.302229 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-23324fee-c125-46ec-aa19-3fe574bd7e18 req-653b59b7-a55f-42e8-b331-e123e028ac0d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031782 Jul 04 04:23:41.302839 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 446/877] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:23:41.855699 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-70d19d7d-4d71-46ae-b6ff-bf61ccc0e115 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:41.857499 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-70d19d7d-4d71-46ae-b6ff-bf61ccc0e115 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:41.862209 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5bffbe50-e950-4615-8015-4fa89541641d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:41.863448 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5bffbe50-e950-4615-8015-4fa89541641d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:41.868096 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70d19d7d-4d71-46ae-b6ff-bf61ccc0e115 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:41.868556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70d19d7d-4d71-46ae-b6ff-bf61ccc0e115 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:41.869332 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70d19d7d-4d71-46ae-b6ff-bf61ccc0e115 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:41.869773 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70d19d7d-4d71-46ae-b6ff-bf61ccc0e115 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:41.871672 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5bffbe50-e950-4615-8015-4fa89541641d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:41.872103 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5bffbe50-e950-4615-8015-4fa89541641d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:41.872862 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5bffbe50-e950-4615-8015-4fa89541641d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:41.873316 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5bffbe50-e950-4615-8015-4fa89541641d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:41.998070 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-70d19d7d-4d71-46ae-b6ff-bf61ccc0e115 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:42.003124 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5bffbe50-e950-4615-8015-4fa89541641d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:42.006141 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-70d19d7d-4d71-46ae-b6ff-bf61ccc0e115 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1723 microversion: 2.1 time: 0.157156 Jul 04 04:23:42.006814 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 432/878] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:23:41 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:23:42.012060 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5bffbe50-e950-4615-8015-4fa89541641d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:42.013612 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5bffbe50-e950-4615-8015-4fa89541641d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:42.014885 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5bffbe50-e950-4615-8015-4fa89541641d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1746 microversion: 2.20 time: 0.160034 Jul 04 04:23:42.015572 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 447/879] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:41 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:43.027933 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-165016ca-b582-476c-a695-7ee4fdc43db9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:43.029037 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-165016ca-b582-476c-a695-7ee4fdc43db9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:43.037030 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a7c5b1e0-3fd6-464b-b9c3-ac0d6bd4de3d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:43.038037 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a7c5b1e0-3fd6-464b-b9c3-ac0d6bd4de3d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:43.039763 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-165016ca-b582-476c-a695-7ee4fdc43db9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:43.040216 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-165016ca-b582-476c-a695-7ee4fdc43db9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:43.040999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-165016ca-b582-476c-a695-7ee4fdc43db9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:43.041428 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-165016ca-b582-476c-a695-7ee4fdc43db9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:43.045038 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a7c5b1e0-3fd6-464b-b9c3-ac0d6bd4de3d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:43.045536 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a7c5b1e0-3fd6-464b-b9c3-ac0d6bd4de3d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:43.046332 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a7c5b1e0-3fd6-464b-b9c3-ac0d6bd4de3d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:43.046819 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a7c5b1e0-3fd6-464b-b9c3-ac0d6bd4de3d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:43.181572 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-165016ca-b582-476c-a695-7ee4fdc43db9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:43.184389 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a7c5b1e0-3fd6-464b-b9c3-ac0d6bd4de3d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:43.189939 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-165016ca-b582-476c-a695-7ee4fdc43db9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1723 microversion: 2.1 time: 0.168628 Jul 04 04:23:43.190777 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 433/880] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:23:43 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:23:43.192398 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a7c5b1e0-3fd6-464b-b9c3-ac0d6bd4de3d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:43.193894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a7c5b1e0-3fd6-464b-b9c3-ac0d6bd4de3d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:43.195148 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a7c5b1e0-3fd6-464b-b9c3-ac0d6bd4de3d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1746 microversion: 2.20 time: 0.164648 Jul 04 04:23:43.196521 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 448/881] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:43 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:44.215152 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-89fff01f-8bec-4fee-b377-3df757d1af5d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:44.215793 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-89fff01f-8bec-4fee-b377-3df757d1af5d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:44.218972 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d4710fad-ebac-4143-b011-e61b0ee037b7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:44.219599 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d4710fad-ebac-4143-b011-e61b0ee037b7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:44.231707 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-89fff01f-8bec-4fee-b377-3df757d1af5d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:44.232149 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-89fff01f-8bec-4fee-b377-3df757d1af5d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:44.232939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-89fff01f-8bec-4fee-b377-3df757d1af5d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:44.234590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4710fad-ebac-4143-b011-e61b0ee037b7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:44.235435 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4710fad-ebac-4143-b011-e61b0ee037b7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:44.237510 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4710fad-ebac-4143-b011-e61b0ee037b7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:44.237957 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4710fad-ebac-4143-b011-e61b0ee037b7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:44.242295 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-89fff01f-8bec-4fee-b377-3df757d1af5d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:44.289447 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=100 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:23:44.425862 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d4710fad-ebac-4143-b011-e61b0ee037b7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:44.436467 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d4710fad-ebac-4143-b011-e61b0ee037b7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1723 microversion: 2.1 time: 0.232331 Jul 04 04:23:44.437804 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 434/882] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:23:44 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:23:44.450069 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-89fff01f-8bec-4fee-b377-3df757d1af5d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:44.458816 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-89fff01f-8bec-4fee-b377-3df757d1af5d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:44.460744 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-89fff01f-8bec-4fee-b377-3df757d1af5d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:44.462281 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-89fff01f-8bec-4fee-b377-3df757d1af5d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1741 microversion: 2.20 time: 0.253190 Jul 04 04:23:44.463397 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 449/883] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:44 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1741 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 04:23:45.455142 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e9d04bbb-fcbc-4852-af60-929007bdf80c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:45.455773 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e9d04bbb-fcbc-4852-af60-929007bdf80c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:45.463542 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9d04bbb-fcbc-4852-af60-929007bdf80c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:45.463995 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9d04bbb-fcbc-4852-af60-929007bdf80c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:45.464783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9d04bbb-fcbc-4852-af60-929007bdf80c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:45.465213 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e9d04bbb-fcbc-4852-af60-929007bdf80c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:45.481686 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e847e8fa-3993-46c1-bf1d-5d4d023d1a14 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:45.483035 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e847e8fa-3993-46c1-bf1d-5d4d023d1a14 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:45.490194 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e847e8fa-3993-46c1-bf1d-5d4d023d1a14 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:45.490646 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e847e8fa-3993-46c1-bf1d-5d4d023d1a14 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:45.491638 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e847e8fa-3993-46c1-bf1d-5d4d023d1a14 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:45.492272 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e847e8fa-3993-46c1-bf1d-5d4d023d1a14 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:45.633373 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e9d04bbb-fcbc-4852-af60-929007bdf80c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:45.644112 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e9d04bbb-fcbc-4852-af60-929007bdf80c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1723 microversion: 2.1 time: 0.192800 Jul 04 04:23:45.648298 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 435/884] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:23:45 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:23:45.650622 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e847e8fa-3993-46c1-bf1d-5d4d023d1a14 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:45.659199 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e847e8fa-3993-46c1-bf1d-5d4d023d1a14 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:45.661262 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e847e8fa-3993-46c1-bf1d-5d4d023d1a14 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:45.662712 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e847e8fa-3993-46c1-bf1d-5d4d023d1a14 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1741 microversion: 2.20 time: 0.185175 Jul 04 04:23:45.663622 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 450/885] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:45 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:46.662112 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-39bf0446-18cb-4140-995e-10638b47020d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:46.662745 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-39bf0446-18cb-4140-995e-10638b47020d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:46.670819 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39bf0446-18cb-4140-995e-10638b47020d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:46.671735 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39bf0446-18cb-4140-995e-10638b47020d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:46.673012 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39bf0446-18cb-4140-995e-10638b47020d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:46.673453 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39bf0446-18cb-4140-995e-10638b47020d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:46.681410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-dc289471-413e-41ee-b0c2-46b920e8bc33 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:46.682525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-dc289471-413e-41ee-b0c2-46b920e8bc33 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:46.692523 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dc289471-413e-41ee-b0c2-46b920e8bc33 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:46.692967 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dc289471-413e-41ee-b0c2-46b920e8bc33 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:46.693769 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dc289471-413e-41ee-b0c2-46b920e8bc33 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:46.706566 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dc289471-413e-41ee-b0c2-46b920e8bc33 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:46.854324 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-39bf0446-18cb-4140-995e-10638b47020d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:46.862962 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-39bf0446-18cb-4140-995e-10638b47020d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1723 microversion: 2.1 time: 0.205656 Jul 04 04:23:46.863542 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 436/886] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:23:46 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:23:46.872785 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-dc289471-413e-41ee-b0c2-46b920e8bc33 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:46.877039 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-dc289471-413e-41ee-b0c2-46b920e8bc33 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:46.878941 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-dc289471-413e-41ee-b0c2-46b920e8bc33 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:46.880114 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-dc289471-413e-41ee-b0c2-46b920e8bc33 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1741 microversion: 2.20 time: 0.203011 Jul 04 04:23:46.880682 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 451/887] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:46 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 04:23:47.881362 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-68ada70b-ea41-47a2-8d81-e3ae1c9f78ab tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:47.883795 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-68ada70b-ea41-47a2-8d81-e3ae1c9f78ab tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:47.892483 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68ada70b-ea41-47a2-8d81-e3ae1c9f78ab tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:47.893143 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68ada70b-ea41-47a2-8d81-e3ae1c9f78ab tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:47.894269 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68ada70b-ea41-47a2-8d81-e3ae1c9f78ab tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:47.894727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68ada70b-ea41-47a2-8d81-e3ae1c9f78ab tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:47.899749 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3dedc31a-dc09-47dc-9ddd-fcdc9559f3f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:47.900521 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-3dedc31a-dc09-47dc-9ddd-fcdc9559f3f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:47.905986 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=41 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:23:47.909042 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3dedc31a-dc09-47dc-9ddd-fcdc9559f3f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:47.910167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3dedc31a-dc09-47dc-9ddd-fcdc9559f3f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:47.911289 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3dedc31a-dc09-47dc-9ddd-fcdc9559f3f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:47.911799 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3dedc31a-dc09-47dc-9ddd-fcdc9559f3f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:48.064845 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-68ada70b-ea41-47a2-8d81-e3ae1c9f78ab tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:48.070294 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-3dedc31a-dc09-47dc-9ddd-fcdc9559f3f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:48.077458 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-68ada70b-ea41-47a2-8d81-e3ae1c9f78ab tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1700 microversion: 2.1 time: 0.200521 Jul 04 04:23:48.082413 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 437/888] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:23:47 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1700 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:23:48.082584 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-3dedc31a-dc09-47dc-9ddd-fcdc9559f3f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:48.082584 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-3dedc31a-dc09-47dc-9ddd-fcdc9559f3f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:48.083326 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3dedc31a-dc09-47dc-9ddd-fcdc9559f3f6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1741 microversion: 2.20 time: 0.187958 Jul 04 04:23:48.083992 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 452/889] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:47 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 04:23:48.103286 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b6ec6c24-36c6-4857-958d-fa4937368980 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:23:48.111565 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6ec6c24-36c6-4857-958d-fa4937368980 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:48.112018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6ec6c24-36c6-4857-958d-fa4937368980 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:48.139589 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b6ec6c24-36c6-4857-958d-fa4937368980 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Going to try to start instance {{(pid=117877) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 04 04:23:48.190185 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b6ec6c24-36c6-4857-958d-fa4937368980 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "POST /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296/action" status: 202 len: 0 microversion: 2.1 time: 0.091672 Jul 04 04:23:48.191629 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 438/890] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 4 04:23:48 2022] POST /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:23:48.206487 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-87a851bc-fb32-4bfe-8294-315edc78e054 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:48.207103 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-87a851bc-fb32-4bfe-8294-315edc78e054 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:48.217155 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-87a851bc-fb32-4bfe-8294-315edc78e054 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:48.217566 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-87a851bc-fb32-4bfe-8294-315edc78e054 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:48.218535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-87a851bc-fb32-4bfe-8294-315edc78e054 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:48.219129 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-87a851bc-fb32-4bfe-8294-315edc78e054 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:48.376477 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-87a851bc-fb32-4bfe-8294-315edc78e054 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:48.386269 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-87a851bc-fb32-4bfe-8294-315edc78e054 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1709 microversion: 2.1 time: 0.190245 Jul 04 04:23:48.386907 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 453/891] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:23:48 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1709 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:23:49.102495 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ff5924de-202f-40ad-a3e0-516ed728e1e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:49.103206 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ff5924de-202f-40ad-a3e0-516ed728e1e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:49.110245 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff5924de-202f-40ad-a3e0-516ed728e1e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:49.110836 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff5924de-202f-40ad-a3e0-516ed728e1e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:49.111664 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff5924de-202f-40ad-a3e0-516ed728e1e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:49.112109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff5924de-202f-40ad-a3e0-516ed728e1e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:49.259766 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ff5924de-202f-40ad-a3e0-516ed728e1e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:49.270778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ff5924de-202f-40ad-a3e0-516ed728e1e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:49.273271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ff5924de-202f-40ad-a3e0-516ed728e1e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:49.274563 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ff5924de-202f-40ad-a3e0-516ed728e1e3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1741 microversion: 2.20 time: 0.176739 Jul 04 04:23:49.275318 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 439/892] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:49 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:49.405352 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c249ea16-283f-4c38-9bb2-7987c8a4ee5a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:49.405901 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c249ea16-283f-4c38-9bb2-7987c8a4ee5a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:49.412522 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c249ea16-283f-4c38-9bb2-7987c8a4ee5a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:49.413181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c249ea16-283f-4c38-9bb2-7987c8a4ee5a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:49.414054 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c249ea16-283f-4c38-9bb2-7987c8a4ee5a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:49.414515 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c249ea16-283f-4c38-9bb2-7987c8a4ee5a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:49.556237 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c249ea16-283f-4c38-9bb2-7987c8a4ee5a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:49.564894 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c249ea16-283f-4c38-9bb2-7987c8a4ee5a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1709 microversion: 2.1 time: 0.164531 Jul 04 04:23:49.565503 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 454/893] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:23:49 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1709 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:23:50.296111 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fccf8345-3c27-4547-8359-1088e1bd3a38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:50.296834 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fccf8345-3c27-4547-8359-1088e1bd3a38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:50.299712 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=43 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:23:50.307010 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fccf8345-3c27-4547-8359-1088e1bd3a38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:50.307461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fccf8345-3c27-4547-8359-1088e1bd3a38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:50.308564 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fccf8345-3c27-4547-8359-1088e1bd3a38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:50.309088 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fccf8345-3c27-4547-8359-1088e1bd3a38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:50.446299 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fccf8345-3c27-4547-8359-1088e1bd3a38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:50.454583 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fccf8345-3c27-4547-8359-1088e1bd3a38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:50.457840 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fccf8345-3c27-4547-8359-1088e1bd3a38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:50.459812 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fccf8345-3c27-4547-8359-1088e1bd3a38 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1741 microversion: 2.20 time: 0.168441 Jul 04 04:23:50.460628 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 440/894] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:50 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:50.582292 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-344c99ba-2fa2-4142-a928-53663b1610af tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:50.582885 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-344c99ba-2fa2-4142-a928-53663b1610af tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:50.590625 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-344c99ba-2fa2-4142-a928-53663b1610af tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:50.591196 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-344c99ba-2fa2-4142-a928-53663b1610af tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:50.592044 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-344c99ba-2fa2-4142-a928-53663b1610af tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:50.592687 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-344c99ba-2fa2-4142-a928-53663b1610af tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:50.746714 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-344c99ba-2fa2-4142-a928-53663b1610af tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:50.755786 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-344c99ba-2fa2-4142-a928-53663b1610af tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1713 microversion: 2.1 time: 0.177289 Jul 04 04:23:50.756410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 455/895] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:23:50 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1713 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:23:51.489294 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-00b0a025-4284-40d8-ac9b-a37687bdec24 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:51.489902 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-00b0a025-4284-40d8-ac9b-a37687bdec24 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:51.497787 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00b0a025-4284-40d8-ac9b-a37687bdec24 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:51.498323 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00b0a025-4284-40d8-ac9b-a37687bdec24 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:51.499219 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00b0a025-4284-40d8-ac9b-a37687bdec24 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:51.499901 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-00b0a025-4284-40d8-ac9b-a37687bdec24 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:51.655541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-00b0a025-4284-40d8-ac9b-a37687bdec24 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:51.667192 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-00b0a025-4284-40d8-ac9b-a37687bdec24 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:51.669442 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-00b0a025-4284-40d8-ac9b-a37687bdec24 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:51.670941 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-00b0a025-4284-40d8-ac9b-a37687bdec24 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1741 microversion: 2.20 time: 0.185694 Jul 04 04:23:51.672032 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 441/896] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:51 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:52.690235 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-de15cc11-f763-4f29-9e48-fa631a55ab04 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:52.690869 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-de15cc11-f763-4f29-9e48-fa631a55ab04 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:52.698603 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-de15cc11-f763-4f29-9e48-fa631a55ab04 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:52.699125 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-de15cc11-f763-4f29-9e48-fa631a55ab04 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:52.699993 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-de15cc11-f763-4f29-9e48-fa631a55ab04 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:52.700630 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-de15cc11-f763-4f29-9e48-fa631a55ab04 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:52.855307 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-de15cc11-f763-4f29-9e48-fa631a55ab04 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:52.863869 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-de15cc11-f763-4f29-9e48-fa631a55ab04 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:52.865560 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-de15cc11-f763-4f29-9e48-fa631a55ab04 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:52.866655 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-de15cc11-f763-4f29-9e48-fa631a55ab04 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1741 microversion: 2.20 time: 0.180515 Jul 04 04:23:52.868245 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 456/897] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:52 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:53.887438 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e6bc4d4a-d7fd-4f91-9064-63ca46398485 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:53.888024 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e6bc4d4a-d7fd-4f91-9064-63ca46398485 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:53.894828 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6bc4d4a-d7fd-4f91-9064-63ca46398485 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:53.895283 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6bc4d4a-d7fd-4f91-9064-63ca46398485 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:53.896052 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6bc4d4a-d7fd-4f91-9064-63ca46398485 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:53.896483 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6bc4d4a-d7fd-4f91-9064-63ca46398485 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:54.036309 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e6bc4d4a-d7fd-4f91-9064-63ca46398485 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:54.045801 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e6bc4d4a-d7fd-4f91-9064-63ca46398485 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:54.047317 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e6bc4d4a-d7fd-4f91-9064-63ca46398485 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:54.048493 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e6bc4d4a-d7fd-4f91-9064-63ca46398485 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1741 microversion: 2.20 time: 0.165628 Jul 04 04:23:54.049094 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 442/898] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:53 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:55.073688 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-195b03ba-eb3c-4d4f-9d25-a467c122a27d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:55.074289 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-195b03ba-eb3c-4d4f-9d25-a467c122a27d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:55.081252 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-195b03ba-eb3c-4d4f-9d25-a467c122a27d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:55.081699 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-195b03ba-eb3c-4d4f-9d25-a467c122a27d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:55.082521 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-195b03ba-eb3c-4d4f-9d25-a467c122a27d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:55.082975 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-195b03ba-eb3c-4d4f-9d25-a467c122a27d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:55.226122 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-195b03ba-eb3c-4d4f-9d25-a467c122a27d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:55.235194 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-195b03ba-eb3c-4d4f-9d25-a467c122a27d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:55.236683 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-195b03ba-eb3c-4d4f-9d25-a467c122a27d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:55.237871 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-195b03ba-eb3c-4d4f-9d25-a467c122a27d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1723 microversion: 2.20 time: 0.169156 Jul 04 04:23:55.238465 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 457/899] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:55 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:56.259933 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e2df1d33-b4a4-40c3-a9c7-00f4962131c3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:56.261245 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e2df1d33-b4a4-40c3-a9c7-00f4962131c3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:56.272361 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2df1d33-b4a4-40c3-a9c7-00f4962131c3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:56.273234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2df1d33-b4a4-40c3-a9c7-00f4962131c3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:56.274014 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2df1d33-b4a4-40c3-a9c7-00f4962131c3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:56.274487 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2df1d33-b4a4-40c3-a9c7-00f4962131c3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:56.413717 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e2df1d33-b4a4-40c3-a9c7-00f4962131c3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:56.422029 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e2df1d33-b4a4-40c3-a9c7-00f4962131c3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:56.423557 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e2df1d33-b4a4-40c3-a9c7-00f4962131c3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:56.424729 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e2df1d33-b4a4-40c3-a9c7-00f4962131c3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1723 microversion: 2.20 time: 0.171566 Jul 04 04:23:56.425297 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 443/900] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:56 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:57.443308 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-eea71354-5123-4b5f-92f5-4fc7748a0243 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:57.443944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-eea71354-5123-4b5f-92f5-4fc7748a0243 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:57.451203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-eea71354-5123-4b5f-92f5-4fc7748a0243 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:57.451769 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-eea71354-5123-4b5f-92f5-4fc7748a0243 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:57.452586 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-eea71354-5123-4b5f-92f5-4fc7748a0243 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:57.453146 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-eea71354-5123-4b5f-92f5-4fc7748a0243 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:57.589719 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-eea71354-5123-4b5f-92f5-4fc7748a0243 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:57.598200 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-eea71354-5123-4b5f-92f5-4fc7748a0243 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:57.599701 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-eea71354-5123-4b5f-92f5-4fc7748a0243 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:57.600961 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-eea71354-5123-4b5f-92f5-4fc7748a0243 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1726 microversion: 2.20 time: 0.161613 Jul 04 04:23:57.601631 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 458/901] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:57 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:57.619939 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e920281e-7d3d-4ad0-941e-027e65a5d27f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d8a834b-9382-460a-9bfa-5ba08869bb5a"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:23:57.621041 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e920281e-7d3d-4ad0-941e-027e65a5d27f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:57.627945 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e920281e-7d3d-4ad0-941e-027e65a5d27f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:57.628392 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e920281e-7d3d-4ad0-941e-027e65a5d27f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:57.629149 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e920281e-7d3d-4ad0-941e-027e65a5d27f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:57.629579 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e920281e-7d3d-4ad0-941e-027e65a5d27f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:57.902394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:23:57.915954 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e920281e-7d3d-4ad0-941e-027e65a5d27f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "POST /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300700 Jul 04 04:23:57.916618 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 444/902] 10.222.0.16 () {62 vars in 1363 bytes} [Mon Jul 4 04:23:57 2022] POST /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1/os-volume_attachments => generated 188 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 04:23:58.040484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1982bf87-2067-4c44-88ac-c488176dc4a3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:58.040952 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-1982bf87-2067-4c44-88ac-c488176dc4a3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:58.047695 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1982bf87-2067-4c44-88ac-c488176dc4a3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:58.048156 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1982bf87-2067-4c44-88ac-c488176dc4a3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:58.048936 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1982bf87-2067-4c44-88ac-c488176dc4a3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:58.049373 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1982bf87-2067-4c44-88ac-c488176dc4a3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:58.326022 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-1982bf87-2067-4c44-88ac-c488176dc4a3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1/os-volume_attachments/8d8a834b-9382-460a-9bfa-5ba08869bb5a" status: 202 len: 0 microversion: 2.20 time: 0.291358 Jul 04 04:23:58.327033 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 459/903] 10.222.0.16 () {60 vars in 1456 bytes} [Mon Jul 4 04:23:58 2022] DELETE /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1/os-volume_attachments/8d8a834b-9382-460a-9bfa-5ba08869bb5a => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:23:58.399005 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-35acfac8-9dfa-4778-a268-9e1e9054a888 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:23:58.399569 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-35acfac8-9dfa-4778-a268-9e1e9054a888 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:58.406075 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35acfac8-9dfa-4778-a268-9e1e9054a888 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:58.406545 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35acfac8-9dfa-4778-a268-9e1e9054a888 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:58.407298 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35acfac8-9dfa-4778-a268-9e1e9054a888 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:58.407722 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35acfac8-9dfa-4778-a268-9e1e9054a888 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:58.503931 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-35acfac8-9dfa-4778-a268-9e1e9054a888 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "POST /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1/action" status: 202 len: 0 microversion: 2.20 time: 0.111232 Jul 04 04:23:58.504545 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 445/904] 10.222.0.16 () {62 vars in 1318 bytes} [Mon Jul 4 04:23:58 2022] POST /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:23:58.513065 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-8fcdd2d2-36b7-4fc0-84ad-09b0b55dffd8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:58.513762 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-8fcdd2d2-36b7-4fc0-84ad-09b0b55dffd8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:58.521100 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8fcdd2d2-36b7-4fc0-84ad-09b0b55dffd8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:58.521574 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8fcdd2d2-36b7-4fc0-84ad-09b0b55dffd8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:58.522483 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8fcdd2d2-36b7-4fc0-84ad-09b0b55dffd8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:58.522983 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8fcdd2d2-36b7-4fc0-84ad-09b0b55dffd8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:58.661938 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-8fcdd2d2-36b7-4fc0-84ad-09b0b55dffd8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:58.671501 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-8fcdd2d2-36b7-4fc0-84ad-09b0b55dffd8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:58.672954 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-8fcdd2d2-36b7-4fc0-84ad-09b0b55dffd8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:58.674239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-8fcdd2d2-36b7-4fc0-84ad-09b0b55dffd8 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1674 microversion: 2.20 time: 0.165446 Jul 04 04:23:58.675156 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 460/905] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:58 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:23:59.370848 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-1de7a029-3d7a-4473-b96c-4a6ec3c88246 req-3c6ada3c-1765-4f39-811a-d3ef7709ed8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb99d59a-d33a-48d2-9824-25f44c1f32c1", "name": "network-vif-unplugged", "status": "completed", "tag": "f6b7b5f9-dfd8-4f10-99f9-c155d967e2de"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:23:59.380539 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-1de7a029-3d7a-4473-b96c-4a6ec3c88246 req-3c6ada3c-1765-4f39-811a-d3ef7709ed8c service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:59.381063 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-1de7a029-3d7a-4473-b96c-4a6ec3c88246 req-3c6ada3c-1765-4f39-811a-d3ef7709ed8c service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:59.394244 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-1de7a029-3d7a-4473-b96c-4a6ec3c88246 req-3c6ada3c-1765-4f39-811a-d3ef7709ed8c service nova] Creating event network-vif-unplugged:f6b7b5f9-dfd8-4f10-99f9-c155d967e2de for instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 on hv-cinder-74216 Jul 04 04:23:59.399458 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-1de7a029-3d7a-4473-b96c-4a6ec3c88246 req-3c6ada3c-1765-4f39-811a-d3ef7709ed8c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032684 Jul 04 04:23:59.400054 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 446/906] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:23:59.693419 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-6d94274a-f6e7-403b-abc8-f98df5c8058f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:23:59.694024 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-6d94274a-f6e7-403b-abc8-f98df5c8058f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:23:59.701080 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6d94274a-f6e7-403b-abc8-f98df5c8058f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:59.701523 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6d94274a-f6e7-403b-abc8-f98df5c8058f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:59.702268 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6d94274a-f6e7-403b-abc8-f98df5c8058f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:23:59.702957 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6d94274a-f6e7-403b-abc8-f98df5c8058f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:23:59.840080 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-6d94274a-f6e7-403b-abc8-f98df5c8058f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:59.848640 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-6d94274a-f6e7-403b-abc8-f98df5c8058f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:59.850147 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-6d94274a-f6e7-403b-abc8-f98df5c8058f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:23:59.851474 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-6d94274a-f6e7-403b-abc8-f98df5c8058f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.162057 Jul 04 04:23:59.852052 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 461/907] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:23:59 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:00.870060 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0073814a-ff91-45f8-afc2-c596beed4930 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:00.870934 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0073814a-ff91-45f8-afc2-c596beed4930 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:00.877698 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0073814a-ff91-45f8-afc2-c596beed4930 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:00.878147 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0073814a-ff91-45f8-afc2-c596beed4930 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:00.878947 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0073814a-ff91-45f8-afc2-c596beed4930 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:00.879379 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0073814a-ff91-45f8-afc2-c596beed4930 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:01.040798 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0073814a-ff91-45f8-afc2-c596beed4930 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:01.049704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0073814a-ff91-45f8-afc2-c596beed4930 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:01.051240 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0073814a-ff91-45f8-afc2-c596beed4930 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:01.052431 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0073814a-ff91-45f8-afc2-c596beed4930 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.187025 Jul 04 04:24:01.053197 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 447/908] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:00 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:02.072115 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9f8baafe-d562-44f1-ac73-767b625d3f65 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:02.072755 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-9f8baafe-d562-44f1-ac73-767b625d3f65 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:02.079410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9f8baafe-d562-44f1-ac73-767b625d3f65 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:02.079865 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9f8baafe-d562-44f1-ac73-767b625d3f65 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:02.080673 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9f8baafe-d562-44f1-ac73-767b625d3f65 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:02.081104 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9f8baafe-d562-44f1-ac73-767b625d3f65 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:02.217513 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9f8baafe-d562-44f1-ac73-767b625d3f65 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:02.226195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9f8baafe-d562-44f1-ac73-767b625d3f65 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:02.227912 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9f8baafe-d562-44f1-ac73-767b625d3f65 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:02.229132 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9f8baafe-d562-44f1-ac73-767b625d3f65 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.161272 Jul 04 04:24:02.229690 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 462/909] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:02 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:03.251550 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c545403b-fe29-4a82-b23a-4f7f6350e5a6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:03.252492 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c545403b-fe29-4a82-b23a-4f7f6350e5a6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:03.261592 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c545403b-fe29-4a82-b23a-4f7f6350e5a6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:03.262038 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c545403b-fe29-4a82-b23a-4f7f6350e5a6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:03.262824 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c545403b-fe29-4a82-b23a-4f7f6350e5a6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:03.263280 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c545403b-fe29-4a82-b23a-4f7f6350e5a6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:03.423170 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c545403b-fe29-4a82-b23a-4f7f6350e5a6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:03.433116 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c545403b-fe29-4a82-b23a-4f7f6350e5a6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:03.434603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c545403b-fe29-4a82-b23a-4f7f6350e5a6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:03.435765 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c545403b-fe29-4a82-b23a-4f7f6350e5a6 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.190911 Jul 04 04:24:03.436320 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 448/910] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:03 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:04.453366 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b39f531f-3308-457a-91b7-f07af6e8536e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:04.453972 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b39f531f-3308-457a-91b7-f07af6e8536e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:04.461571 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b39f531f-3308-457a-91b7-f07af6e8536e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:04.462053 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b39f531f-3308-457a-91b7-f07af6e8536e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:04.462872 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b39f531f-3308-457a-91b7-f07af6e8536e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:04.463311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b39f531f-3308-457a-91b7-f07af6e8536e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:04.608005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b39f531f-3308-457a-91b7-f07af6e8536e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:04.610279 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:24:04.618033 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b39f531f-3308-457a-91b7-f07af6e8536e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:04.619580 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b39f531f-3308-457a-91b7-f07af6e8536e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:04.620781 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b39f531f-3308-457a-91b7-f07af6e8536e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.171380 Jul 04 04:24:04.636096 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 463/911] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:04 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:05.639093 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2d5b2721-7594-4ee6-acb0-b640be376511 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:05.639687 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2d5b2721-7594-4ee6-acb0-b640be376511 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:05.647038 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d5b2721-7594-4ee6-acb0-b640be376511 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:05.647737 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d5b2721-7594-4ee6-acb0-b640be376511 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:05.648508 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d5b2721-7594-4ee6-acb0-b640be376511 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:05.648892 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d5b2721-7594-4ee6-acb0-b640be376511 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:05.788666 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2d5b2721-7594-4ee6-acb0-b640be376511 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:05.797119 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2d5b2721-7594-4ee6-acb0-b640be376511 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:05.799134 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2d5b2721-7594-4ee6-acb0-b640be376511 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:05.802823 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2d5b2721-7594-4ee6-acb0-b640be376511 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.167190 Jul 04 04:24:05.803075 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 449/912] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:05 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:06.823247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-87f36c5a-186a-413e-90e4-5c48da8bb529 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:06.823863 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-87f36c5a-186a-413e-90e4-5c48da8bb529 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:06.832059 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-87f36c5a-186a-413e-90e4-5c48da8bb529 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:06.832512 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-87f36c5a-186a-413e-90e4-5c48da8bb529 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:06.833311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-87f36c5a-186a-413e-90e4-5c48da8bb529 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:06.833752 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-87f36c5a-186a-413e-90e4-5c48da8bb529 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:06.969781 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-87f36c5a-186a-413e-90e4-5c48da8bb529 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:06.978023 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-87f36c5a-186a-413e-90e4-5c48da8bb529 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:06.979652 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-87f36c5a-186a-413e-90e4-5c48da8bb529 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:06.980693 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-87f36c5a-186a-413e-90e4-5c48da8bb529 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.162875 Jul 04 04:24:06.981254 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 464/913] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:06 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:07.999193 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1eb4f9fc-74fa-4bf1-80e9-ccc5fe389f0f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:08.000486 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1eb4f9fc-74fa-4bf1-80e9-ccc5fe389f0f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:08.006849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1eb4f9fc-74fa-4bf1-80e9-ccc5fe389f0f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:08.007393 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1eb4f9fc-74fa-4bf1-80e9-ccc5fe389f0f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:08.008045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1eb4f9fc-74fa-4bf1-80e9-ccc5fe389f0f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:08.008723 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1eb4f9fc-74fa-4bf1-80e9-ccc5fe389f0f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:08.146194 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1eb4f9fc-74fa-4bf1-80e9-ccc5fe389f0f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:08.155104 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1eb4f9fc-74fa-4bf1-80e9-ccc5fe389f0f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:08.156595 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1eb4f9fc-74fa-4bf1-80e9-ccc5fe389f0f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:08.157767 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1eb4f9fc-74fa-4bf1-80e9-ccc5fe389f0f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.162553 Jul 04 04:24:08.158339 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 450/914] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:07 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:09.177179 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c83c4441-3425-4a1f-8816-42c0fbafc87a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:09.177770 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c83c4441-3425-4a1f-8816-42c0fbafc87a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:09.185091 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c83c4441-3425-4a1f-8816-42c0fbafc87a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:09.185555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c83c4441-3425-4a1f-8816-42c0fbafc87a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:09.186334 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c83c4441-3425-4a1f-8816-42c0fbafc87a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:09.186793 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c83c4441-3425-4a1f-8816-42c0fbafc87a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:09.336977 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c83c4441-3425-4a1f-8816-42c0fbafc87a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:09.345415 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c83c4441-3425-4a1f-8816-42c0fbafc87a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:09.346924 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c83c4441-3425-4a1f-8816-42c0fbafc87a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:09.348141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c83c4441-3425-4a1f-8816-42c0fbafc87a tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.174874 Jul 04 04:24:09.348681 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 465/915] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:09 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:10.367374 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8d7920d5-093d-4475-9707-f3f657364462 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:10.368150 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8d7920d5-093d-4475-9707-f3f657364462 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:10.374890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d7920d5-093d-4475-9707-f3f657364462 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:10.375339 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d7920d5-093d-4475-9707-f3f657364462 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:10.376094 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d7920d5-093d-4475-9707-f3f657364462 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:10.376524 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d7920d5-093d-4475-9707-f3f657364462 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:10.511850 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8d7920d5-093d-4475-9707-f3f657364462 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:10.520006 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8d7920d5-093d-4475-9707-f3f657364462 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:10.521751 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8d7920d5-093d-4475-9707-f3f657364462 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:10.523007 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8d7920d5-093d-4475-9707-f3f657364462 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.159605 Jul 04 04:24:10.523583 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 451/916] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:10 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:11.543532 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-4135db47-a0b7-4d9b-a1d9-7781e62c8bab tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:11.544146 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-4135db47-a0b7-4d9b-a1d9-7781e62c8bab tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:11.551290 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4135db47-a0b7-4d9b-a1d9-7781e62c8bab tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:11.551746 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4135db47-a0b7-4d9b-a1d9-7781e62c8bab tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:11.552523 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4135db47-a0b7-4d9b-a1d9-7781e62c8bab tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:11.552963 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4135db47-a0b7-4d9b-a1d9-7781e62c8bab tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:11.695574 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-4135db47-a0b7-4d9b-a1d9-7781e62c8bab tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:11.704477 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-4135db47-a0b7-4d9b-a1d9-7781e62c8bab tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:11.705987 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-4135db47-a0b7-4d9b-a1d9-7781e62c8bab tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:11.707250 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-4135db47-a0b7-4d9b-a1d9-7781e62c8bab tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.168342 Jul 04 04:24:11.707826 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 466/917] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:11 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:12.732892 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8ce82f5b-4cd2-4f5e-bd4d-1211837731cd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:12.733733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8ce82f5b-4cd2-4f5e-bd4d-1211837731cd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:12.741440 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ce82f5b-4cd2-4f5e-bd4d-1211837731cd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:12.741908 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ce82f5b-4cd2-4f5e-bd4d-1211837731cd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:12.742685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ce82f5b-4cd2-4f5e-bd4d-1211837731cd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:12.743123 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ce82f5b-4cd2-4f5e-bd4d-1211837731cd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:12.881649 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8ce82f5b-4cd2-4f5e-bd4d-1211837731cd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:12.891168 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8ce82f5b-4cd2-4f5e-bd4d-1211837731cd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:12.892663 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8ce82f5b-4cd2-4f5e-bd4d-1211837731cd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:12.893859 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8ce82f5b-4cd2-4f5e-bd4d-1211837731cd tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.170449 Jul 04 04:24:12.894657 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 452/918] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:12 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:13.916314 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-19994e89-d3e4-419d-a10a-bd251e0dee46 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:13.917234 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-19994e89-d3e4-419d-a10a-bd251e0dee46 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:13.928422 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-19994e89-d3e4-419d-a10a-bd251e0dee46 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:13.929158 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-19994e89-d3e4-419d-a10a-bd251e0dee46 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:13.931021 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-19994e89-d3e4-419d-a10a-bd251e0dee46 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:13.931732 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-19994e89-d3e4-419d-a10a-bd251e0dee46 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:14.093766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-19994e89-d3e4-419d-a10a-bd251e0dee46 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:14.101821 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-19994e89-d3e4-419d-a10a-bd251e0dee46 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:14.103306 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-19994e89-d3e4-419d-a10a-bd251e0dee46 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:14.104443 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-19994e89-d3e4-419d-a10a-bd251e0dee46 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.194870 Jul 04 04:24:14.104997 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 467/919] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:13 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:15.127874 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-55fac4da-48d0-43ff-beda-51cd548256f0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:15.128992 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-55fac4da-48d0-43ff-beda-51cd548256f0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:15.140645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55fac4da-48d0-43ff-beda-51cd548256f0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:15.141105 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55fac4da-48d0-43ff-beda-51cd548256f0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:15.141891 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55fac4da-48d0-43ff-beda-51cd548256f0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:15.142327 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55fac4da-48d0-43ff-beda-51cd548256f0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:15.286595 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-55fac4da-48d0-43ff-beda-51cd548256f0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:15.294752 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-55fac4da-48d0-43ff-beda-51cd548256f0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:15.296283 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-55fac4da-48d0-43ff-beda-51cd548256f0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:15.297619 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-55fac4da-48d0-43ff-beda-51cd548256f0 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.176667 Jul 04 04:24:15.298157 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 453/920] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:15 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:15.393258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5ed83549-983d-4656-affb-c3c5141390ec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1440009761", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1321978684", "security_groups": [{"name": "tempest-secgroup-smoke-122465126"}], "block_device_mapping_v2": [{"uuid": "61ae83b7-7151-4d11-84ee-431a440f8c61", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1d07c9ba-9977-4c1a-95be-b18ead1c7da1"}]}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:24:15.506339 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.network.neutron [None req-5ed83549-983d-4656-affb-c3c5141390ec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] validate_networks() for [('1d07c9ba-9977-4c1a-95be-b18ead1c7da1', None, None, None, None, None)] {{(pid=117875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:24:16.079869 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-5ed83549-983d-4656-affb-c3c5141390ec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Flavor limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:24:16.080429 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-5ed83549-983d-4656-affb-c3c5141390ec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Image limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:24:16.081139 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-5ed83549-983d-4656-affb-c3c5141390ec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Flavor pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:24:16.081714 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-5ed83549-983d-4656-affb-c3c5141390ec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Image pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:24:16.082285 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-5ed83549-983d-4656-affb-c3c5141390ec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:24:16.095398 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5ed83549-983d-4656-affb-c3c5141390ec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:16.095842 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5ed83549-983d-4656-affb-c3c5141390ec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:16.096621 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5ed83549-983d-4656-affb-c3c5141390ec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:16.097050 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5ed83549-983d-4656-affb-c3c5141390ec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:16.114756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-5ed83549-983d-4656-affb-c3c5141390ec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Getting quotas for project b622ab692a73432784c63b9ad3290e72. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:24:16.119036 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-5ed83549-983d-4656-affb-c3c5141390ec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Getting quotas for user 34ec54486c9d404896f832b87f99bc11 and project b622ab692a73432784c63b9ad3290e72. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:24:16.189500 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5ed83549-983d-4656-affb-c3c5141390ec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Going to run 1 instances... {{(pid=117875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:24:16.191632 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5ed83549-983d-4656-affb-c3c5141390ec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61ae83b7-7151-4d11-84ee-431a440f8c61',volume_size=None,volume_type=None)] {{(pid=117875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:24:16.316350 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4c5d1f9a-72ce-437a-9d24-5746fe450800 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:16.316938 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4c5d1f9a-72ce-437a-9d24-5746fe450800 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:16.323652 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c5d1f9a-72ce-437a-9d24-5746fe450800 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:16.324103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c5d1f9a-72ce-437a-9d24-5746fe450800 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:16.324876 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c5d1f9a-72ce-437a-9d24-5746fe450800 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:16.325311 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c5d1f9a-72ce-437a-9d24-5746fe450800 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:16.345003 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5ed83549-983d-4656-affb-c3c5141390ec tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.955890 Jul 04 04:24:16.345660 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 468/921] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:24:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 04:24:16.356689 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a3ee94a5-77a4-4f23-b177-7c590e9cc97a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:16.357354 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a3ee94a5-77a4-4f23-b177-7c590e9cc97a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:16.476428 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4c5d1f9a-72ce-437a-9d24-5746fe450800 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:16.487472 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4c5d1f9a-72ce-437a-9d24-5746fe450800 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:16.489396 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4c5d1f9a-72ce-437a-9d24-5746fe450800 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:16.490722 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4c5d1f9a-72ce-437a-9d24-5746fe450800 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.178967 Jul 04 04:24:16.491358 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 454/922] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:16 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:16.667238 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a3ee94a5-77a4-4f23-b177-7c590e9cc97a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:16.674483 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a3ee94a5-77a4-4f23-b177-7c590e9cc97a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1095 microversion: 2.1 time: 0.322639 Jul 04 04:24:16.675073 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 469/923] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:16 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1095 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:24:17.513740 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2d1a85d0-139e-44cc-9b67-2e61e8e84324 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:17.514727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2d1a85d0-139e-44cc-9b67-2e61e8e84324 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:17.525876 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d1a85d0-139e-44cc-9b67-2e61e8e84324 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:17.526671 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d1a85d0-139e-44cc-9b67-2e61e8e84324 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:17.527929 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d1a85d0-139e-44cc-9b67-2e61e8e84324 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:17.528854 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d1a85d0-139e-44cc-9b67-2e61e8e84324 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:17.685367 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2d1a85d0-139e-44cc-9b67-2e61e8e84324 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:17.691783 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c53f3785-ae46-4da3-8022-25ae1b47a0aa tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:17.692419 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c53f3785-ae46-4da3-8022-25ae1b47a0aa tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:17.694178 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2d1a85d0-139e-44cc-9b67-2e61e8e84324 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:17.695724 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2d1a85d0-139e-44cc-9b67-2e61e8e84324 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:17.696906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2d1a85d0-139e-44cc-9b67-2e61e8e84324 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.190253 Jul 04 04:24:17.697443 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 455/924] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:17 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:17.699108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c53f3785-ae46-4da3-8022-25ae1b47a0aa tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:17.699557 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c53f3785-ae46-4da3-8022-25ae1b47a0aa tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:17.700319 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c53f3785-ae46-4da3-8022-25ae1b47a0aa tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:17.700777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c53f3785-ae46-4da3-8022-25ae1b47a0aa tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:17.768010 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c53f3785-ae46-4da3-8022-25ae1b47a0aa tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:17.775590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c53f3785-ae46-4da3-8022-25ae1b47a0aa tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1145 microversion: 2.1 time: 0.087665 Jul 04 04:24:17.776143 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 470/925] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:17 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:18.717086 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f424aa48-cb95-4cff-9a1b-223dea890fdf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:18.717863 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f424aa48-cb95-4cff-9a1b-223dea890fdf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:18.726899 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f424aa48-cb95-4cff-9a1b-223dea890fdf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:18.727492 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f424aa48-cb95-4cff-9a1b-223dea890fdf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:18.728518 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f424aa48-cb95-4cff-9a1b-223dea890fdf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:18.729087 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f424aa48-cb95-4cff-9a1b-223dea890fdf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:18.793268 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-52afb941-0ab3-460e-827a-766036e4cbb5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:18.793965 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-52afb941-0ab3-460e-827a-766036e4cbb5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:18.796624 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:24:18.802478 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-52afb941-0ab3-460e-827a-766036e4cbb5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:18.802909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-52afb941-0ab3-460e-827a-766036e4cbb5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:18.803705 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-52afb941-0ab3-460e-827a-766036e4cbb5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:18.804137 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-52afb941-0ab3-460e-827a-766036e4cbb5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:18.864113 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f424aa48-cb95-4cff-9a1b-223dea890fdf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:18.868669 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-52afb941-0ab3-460e-827a-766036e4cbb5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:18.872317 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f424aa48-cb95-4cff-9a1b-223dea890fdf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:18.873836 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f424aa48-cb95-4cff-9a1b-223dea890fdf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:18.875176 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f424aa48-cb95-4cff-9a1b-223dea890fdf tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.163383 Jul 04 04:24:18.875713 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 456/926] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:18 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:18.876484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-52afb941-0ab3-460e-827a-766036e4cbb5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1145 microversion: 2.1 time: 0.087190 Jul 04 04:24:18.877165 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 471/927] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:18 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:19.894826 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d7f37e01-8148-43c2-bc19-d810d6935ac4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:19.895503 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d7f37e01-8148-43c2-bc19-d810d6935ac4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:19.899278 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-56344920-1b38-43e1-aee6-1b9ab79182d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:19.899917 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-56344920-1b38-43e1-aee6-1b9ab79182d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:19.910116 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d7f37e01-8148-43c2-bc19-d810d6935ac4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:19.910935 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d7f37e01-8148-43c2-bc19-d810d6935ac4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:19.911719 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d7f37e01-8148-43c2-bc19-d810d6935ac4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:19.912112 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56344920-1b38-43e1-aee6-1b9ab79182d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:19.912562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56344920-1b38-43e1-aee6-1b9ab79182d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:19.912745 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d7f37e01-8148-43c2-bc19-d810d6935ac4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:19.913352 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56344920-1b38-43e1-aee6-1b9ab79182d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:19.913781 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56344920-1b38-43e1-aee6-1b9ab79182d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:19.978962 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d7f37e01-8148-43c2-bc19-d810d6935ac4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:19.987039 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d7f37e01-8148-43c2-bc19-d810d6935ac4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1211 microversion: 2.1 time: 0.096172 Jul 04 04:24:19.987779 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 472/928] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:19 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:20.124024 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-56344920-1b38-43e1-aee6-1b9ab79182d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:20.133043 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-56344920-1b38-43e1-aee6-1b9ab79182d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:20.134484 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-56344920-1b38-43e1-aee6-1b9ab79182d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:20.136021 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-56344920-1b38-43e1-aee6-1b9ab79182d4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.246763 Jul 04 04:24:20.139919 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 457/929] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:19 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:21.005481 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-165fb92b-0132-4635-a889-5014748da763 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:21.006139 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-165fb92b-0132-4635-a889-5014748da763 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:21.013382 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-165fb92b-0132-4635-a889-5014748da763 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:21.014274 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-165fb92b-0132-4635-a889-5014748da763 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:21.015481 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-165fb92b-0132-4635-a889-5014748da763 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:21.016329 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-165fb92b-0132-4635-a889-5014748da763 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:21.155283 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5334cfd7-4286-4d14-9457-aecf0ec88c3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:21.156211 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5334cfd7-4286-4d14-9457-aecf0ec88c3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:21.162795 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=38 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:24:21.167330 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5334cfd7-4286-4d14-9457-aecf0ec88c3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:21.169143 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-165fb92b-0132-4635-a889-5014748da763 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:21.169842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5334cfd7-4286-4d14-9457-aecf0ec88c3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:21.170746 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5334cfd7-4286-4d14-9457-aecf0ec88c3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:21.172813 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5334cfd7-4286-4d14-9457-aecf0ec88c3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:21.176947 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-165fb92b-0132-4635-a889-5014748da763 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1266 microversion: 2.1 time: 0.175584 Jul 04 04:24:21.187059 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 473/930] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:21 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:21.201924 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-71bea8a8-4383-4da6-a6ce-8ad38cd9a4a7 req-ac8ba5b6-d3e2-4761-bd91-61ae620c2072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc477aae-9332-481d-bb4f-d1d8ff671c43", "tag": "9a95c8cb-e9e6-4776-92fc-f9a7a4174643"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:24:21.221585 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-71bea8a8-4383-4da6-a6ce-8ad38cd9a4a7 req-ac8ba5b6-d3e2-4761-bd91-61ae620c2072 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:21.222569 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-71bea8a8-4383-4da6-a6ce-8ad38cd9a4a7 req-ac8ba5b6-d3e2-4761-bd91-61ae620c2072 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:21.243380 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-71bea8a8-4383-4da6-a6ce-8ad38cd9a4a7 req-ac8ba5b6-d3e2-4761-bd91-61ae620c2072 service nova] Creating event network-changed:9a95c8cb-e9e6-4776-92fc-f9a7a4174643 for instance dc477aae-9332-481d-bb4f-d1d8ff671c43 on hv-cinder-74216 Jul 04 04:24:21.248804 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-71bea8a8-4383-4da6-a6ce-8ad38cd9a4a7 req-ac8ba5b6-d3e2-4761-bd91-61ae620c2072 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052527 Jul 04 04:24:21.250161 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 474/931] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:24:21.418193 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5334cfd7-4286-4d14-9457-aecf0ec88c3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:21.427910 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5334cfd7-4286-4d14-9457-aecf0ec88c3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:21.429400 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5334cfd7-4286-4d14-9457-aecf0ec88c3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:21.430599 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5334cfd7-4286-4d14-9457-aecf0ec88c3f tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.279683 Jul 04 04:24:21.431342 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 458/932] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:21 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:21.577345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-fa4554d2-6e16-4eca-a058-cc40babd0797 req-452858e0-a069-4bac-a02b-45fe0f26aa78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb99d59a-d33a-48d2-9824-25f44c1f32c1", "name": "network-vif-plugged", "status": "completed", "tag": "f6b7b5f9-dfd8-4f10-99f9-c155d967e2de"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:24:21.587865 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-fa4554d2-6e16-4eca-a058-cc40babd0797 req-452858e0-a069-4bac-a02b-45fe0f26aa78 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:21.588621 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-fa4554d2-6e16-4eca-a058-cc40babd0797 req-452858e0-a069-4bac-a02b-45fe0f26aa78 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:21.602650 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-fa4554d2-6e16-4eca-a058-cc40babd0797 req-452858e0-a069-4bac-a02b-45fe0f26aa78 service nova] Creating event network-vif-plugged:f6b7b5f9-dfd8-4f10-99f9-c155d967e2de for instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 on hv-cinder-74216 Jul 04 04:24:21.607744 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-fa4554d2-6e16-4eca-a058-cc40babd0797 req-452858e0-a069-4bac-a02b-45fe0f26aa78 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034458 Jul 04 04:24:21.608515 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 475/933] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:24:22.197771 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ac132cb9-d2af-43a4-91b5-8e65b611cf0f tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:22.198762 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ac132cb9-d2af-43a4-91b5-8e65b611cf0f tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:22.210159 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac132cb9-d2af-43a4-91b5-8e65b611cf0f tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:22.211028 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac132cb9-d2af-43a4-91b5-8e65b611cf0f tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:22.212244 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac132cb9-d2af-43a4-91b5-8e65b611cf0f tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:22.212963 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac132cb9-d2af-43a4-91b5-8e65b611cf0f tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:22.353186 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ac132cb9-d2af-43a4-91b5-8e65b611cf0f tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:22.362821 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ac132cb9-d2af-43a4-91b5-8e65b611cf0f tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1266 microversion: 2.1 time: 0.171437 Jul 04 04:24:22.363395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 459/934] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:22 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:22.454925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1ffaa539-34d8-471e-8642-724eaa1887ea tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:22.455591 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-1ffaa539-34d8-471e-8642-724eaa1887ea tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:22.463269 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1ffaa539-34d8-471e-8642-724eaa1887ea tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:22.463755 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1ffaa539-34d8-471e-8642-724eaa1887ea tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:22.464708 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1ffaa539-34d8-471e-8642-724eaa1887ea tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:22.465213 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1ffaa539-34d8-471e-8642-724eaa1887ea tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:22.607920 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-1ffaa539-34d8-471e-8642-724eaa1887ea tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:22.617174 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-1ffaa539-34d8-471e-8642-724eaa1887ea tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:22.618742 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-1ffaa539-34d8-471e-8642-724eaa1887ea tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:22.619928 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-1ffaa539-34d8-471e-8642-724eaa1887ea tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.172452 Jul 04 04:24:22.620519 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 476/935] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:22 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:23.383306 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bba28175-cc97-4b7d-985a-b97f5c3f9b2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:23.384333 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bba28175-cc97-4b7d-985a-b97f5c3f9b2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:23.394128 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bba28175-cc97-4b7d-985a-b97f5c3f9b2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:23.394623 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bba28175-cc97-4b7d-985a-b97f5c3f9b2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:23.395394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bba28175-cc97-4b7d-985a-b97f5c3f9b2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:23.395829 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bba28175-cc97-4b7d-985a-b97f5c3f9b2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:23.603596 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bba28175-cc97-4b7d-985a-b97f5c3f9b2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:23.607241 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:24:23.613393 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bba28175-cc97-4b7d-985a-b97f5c3f9b2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1266 microversion: 2.1 time: 0.236393 Jul 04 04:24:23.614198 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 460/936] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:23 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:23.639402 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d190aa77-ad0a-42c7-a6c8-5eddb6694a0d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:23.640193 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d190aa77-ad0a-42c7-a6c8-5eddb6694a0d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:23.647501 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d190aa77-ad0a-42c7-a6c8-5eddb6694a0d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:23.647951 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d190aa77-ad0a-42c7-a6c8-5eddb6694a0d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:23.648724 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d190aa77-ad0a-42c7-a6c8-5eddb6694a0d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:23.649157 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d190aa77-ad0a-42c7-a6c8-5eddb6694a0d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:23.788596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d190aa77-ad0a-42c7-a6c8-5eddb6694a0d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:23.797560 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d190aa77-ad0a-42c7-a6c8-5eddb6694a0d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:23.799095 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d190aa77-ad0a-42c7-a6c8-5eddb6694a0d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:23.800274 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d190aa77-ad0a-42c7-a6c8-5eddb6694a0d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.165470 Jul 04 04:24:23.800826 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 477/937] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:23 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:24.634161 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-06b4f5cb-1190-42c9-adee-4086af6fba18 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:24.635842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-06b4f5cb-1190-42c9-adee-4086af6fba18 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:24.643949 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06b4f5cb-1190-42c9-adee-4086af6fba18 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:24.644385 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06b4f5cb-1190-42c9-adee-4086af6fba18 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:24.645365 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06b4f5cb-1190-42c9-adee-4086af6fba18 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:24.646231 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06b4f5cb-1190-42c9-adee-4086af6fba18 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:24.783445 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-06b4f5cb-1190-42c9-adee-4086af6fba18 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:24.791555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-06b4f5cb-1190-42c9-adee-4086af6fba18 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1266 microversion: 2.1 time: 0.161280 Jul 04 04:24:24.792149 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 461/938] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:24 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:24.819174 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e0067e4f-6a94-4950-9503-12638b929535 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:24.819729 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e0067e4f-6a94-4950-9503-12638b929535 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:24.827006 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e0067e4f-6a94-4950-9503-12638b929535 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:24.827807 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e0067e4f-6a94-4950-9503-12638b929535 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:24.829141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e0067e4f-6a94-4950-9503-12638b929535 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:24.829640 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e0067e4f-6a94-4950-9503-12638b929535 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:24.965250 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e0067e4f-6a94-4950-9503-12638b929535 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:24.973497 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e0067e4f-6a94-4950-9503-12638b929535 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:24.975014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e0067e4f-6a94-4950-9503-12638b929535 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:24.976345 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e0067e4f-6a94-4950-9503-12638b929535 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1732 microversion: 2.20 time: 0.161179 Jul 04 04:24:24.976934 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 478/939] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:24 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:25.813071 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6351913d-9c14-4679-81ed-4b509a24a3a5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:25.813730 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6351913d-9c14-4679-81ed-4b509a24a3a5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:25.820927 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6351913d-9c14-4679-81ed-4b509a24a3a5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:25.821376 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6351913d-9c14-4679-81ed-4b509a24a3a5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:25.822134 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6351913d-9c14-4679-81ed-4b509a24a3a5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:25.822596 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6351913d-9c14-4679-81ed-4b509a24a3a5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:25.974512 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6351913d-9c14-4679-81ed-4b509a24a3a5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:25.982117 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6351913d-9c14-4679-81ed-4b509a24a3a5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1266 microversion: 2.1 time: 0.175480 Jul 04 04:24:25.982720 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 462/940] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:25 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:25.996839 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e7a74bc5-4e57-4923-a409-d0bcace41790 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:25.997715 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e7a74bc5-4e57-4923-a409-d0bcace41790 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:26.005264 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7a74bc5-4e57-4923-a409-d0bcace41790 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:26.005712 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7a74bc5-4e57-4923-a409-d0bcace41790 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:26.006501 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7a74bc5-4e57-4923-a409-d0bcace41790 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:26.006938 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7a74bc5-4e57-4923-a409-d0bcace41790 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:26.105029 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=2 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:24:26.142159 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e7a74bc5-4e57-4923-a409-d0bcace41790 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:26.154800 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e7a74bc5-4e57-4923-a409-d0bcace41790 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:26.157232 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e7a74bc5-4e57-4923-a409-d0bcace41790 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:26.159068 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e7a74bc5-4e57-4923-a409-d0bcace41790 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1719 microversion: 2.20 time: 0.167871 Jul 04 04:24:26.159824 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 479/941] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:24:25 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:24:27.003759 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dacef077-2130-4142-b70c-aea09b4789e3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:27.004968 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dacef077-2130-4142-b70c-aea09b4789e3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:27.016727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dacef077-2130-4142-b70c-aea09b4789e3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:27.017173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dacef077-2130-4142-b70c-aea09b4789e3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:27.017917 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dacef077-2130-4142-b70c-aea09b4789e3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:27.018344 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dacef077-2130-4142-b70c-aea09b4789e3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:27.157589 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dacef077-2130-4142-b70c-aea09b4789e3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:27.165579 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dacef077-2130-4142-b70c-aea09b4789e3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1266 microversion: 2.1 time: 0.168909 Jul 04 04:24:27.166161 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 463/942] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:26 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:28.187026 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3c0d168b-a24e-49c1-9ee7-0575377a83f5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:28.187956 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-3c0d168b-a24e-49c1-9ee7-0575377a83f5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:28.189948 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=8 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:24:28.196258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3c0d168b-a24e-49c1-9ee7-0575377a83f5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:28.196724 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3c0d168b-a24e-49c1-9ee7-0575377a83f5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:28.197527 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3c0d168b-a24e-49c1-9ee7-0575377a83f5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:28.197978 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3c0d168b-a24e-49c1-9ee7-0575377a83f5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:28.329603 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-3c0d168b-a24e-49c1-9ee7-0575377a83f5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:28.337442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3c0d168b-a24e-49c1-9ee7-0575377a83f5 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1266 microversion: 2.1 time: 0.156951 Jul 04 04:24:28.338018 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 480/943] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:28 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:29.356194 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-57996dae-b16a-48c2-a6e8-1f9acfcbd03b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:29.356771 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-57996dae-b16a-48c2-a6e8-1f9acfcbd03b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:29.363820 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57996dae-b16a-48c2-a6e8-1f9acfcbd03b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:29.364276 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57996dae-b16a-48c2-a6e8-1f9acfcbd03b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:29.365041 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57996dae-b16a-48c2-a6e8-1f9acfcbd03b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:29.365480 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57996dae-b16a-48c2-a6e8-1f9acfcbd03b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:29.515999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-57996dae-b16a-48c2-a6e8-1f9acfcbd03b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:29.524124 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-57996dae-b16a-48c2-a6e8-1f9acfcbd03b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1266 microversion: 2.1 time: 0.172175 Jul 04 04:24:29.524694 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 464/944] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:29 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:30.547379 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d02e328b-13cc-42bd-aa30-66bf11ba2bc0 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:30.548489 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d02e328b-13cc-42bd-aa30-66bf11ba2bc0 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:30.555397 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d02e328b-13cc-42bd-aa30-66bf11ba2bc0 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:30.555842 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d02e328b-13cc-42bd-aa30-66bf11ba2bc0 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:30.556600 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d02e328b-13cc-42bd-aa30-66bf11ba2bc0 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:30.557029 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d02e328b-13cc-42bd-aa30-66bf11ba2bc0 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:30.701157 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d02e328b-13cc-42bd-aa30-66bf11ba2bc0 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:30.709644 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d02e328b-13cc-42bd-aa30-66bf11ba2bc0 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1266 microversion: 2.1 time: 0.169376 Jul 04 04:24:30.710215 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 481/945] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:30 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:31.637198 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-12b98c7b-dd1d-4c82-8e4f-8a96082c1058 req-70fb9fa9-bcf9-4862-9730-a4347e0d3e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc477aae-9332-481d-bb4f-d1d8ff671c43", "name": "network-vif-plugged", "status": "completed", "tag": "9a95c8cb-e9e6-4776-92fc-f9a7a4174643"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:24:31.646612 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-12b98c7b-dd1d-4c82-8e4f-8a96082c1058 req-70fb9fa9-bcf9-4862-9730-a4347e0d3e05 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:31.647215 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-12b98c7b-dd1d-4c82-8e4f-8a96082c1058 req-70fb9fa9-bcf9-4862-9730-a4347e0d3e05 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:31.659687 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-12b98c7b-dd1d-4c82-8e4f-8a96082c1058 req-70fb9fa9-bcf9-4862-9730-a4347e0d3e05 service nova] Creating event network-vif-plugged:9a95c8cb-e9e6-4776-92fc-f9a7a4174643 for instance dc477aae-9332-481d-bb4f-d1d8ff671c43 on hv-cinder-74216 Jul 04 04:24:31.664830 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-12b98c7b-dd1d-4c82-8e4f-8a96082c1058 req-70fb9fa9-bcf9-4862-9730-a4347e0d3e05 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031825 Jul 04 04:24:31.665790 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 465/946] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:24:31.727149 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f574550a-31d8-4256-b385-2fc53de5894e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:31.727689 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f574550a-31d8-4256-b385-2fc53de5894e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:31.734567 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f574550a-31d8-4256-b385-2fc53de5894e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:31.735020 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f574550a-31d8-4256-b385-2fc53de5894e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:31.735787 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f574550a-31d8-4256-b385-2fc53de5894e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:31.736390 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f574550a-31d8-4256-b385-2fc53de5894e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:31.926079 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f574550a-31d8-4256-b385-2fc53de5894e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:31.933768 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-f574550a-31d8-4256-b385-2fc53de5894e tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1266 microversion: 2.1 time: 0.210961 Jul 04 04:24:31.934332 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 482/947] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:31 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:32.956610 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-28b6e6b0-738e-4219-a141-3e17047c1120 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:32.957321 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-28b6e6b0-738e-4219-a141-3e17047c1120 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:32.964708 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28b6e6b0-738e-4219-a141-3e17047c1120 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:32.965200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28b6e6b0-738e-4219-a141-3e17047c1120 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:32.966057 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28b6e6b0-738e-4219-a141-3e17047c1120 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:32.966596 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28b6e6b0-738e-4219-a141-3e17047c1120 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:33.162747 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-28b6e6b0-738e-4219-a141-3e17047c1120 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:33.170686 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-28b6e6b0-738e-4219-a141-3e17047c1120 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1266 microversion: 2.1 time: 0.221498 Jul 04 04:24:33.171253 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 466/948] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:32 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:34.188349 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-847e7fc2-d98b-418d-be88-94a11d7854c7 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:34.188976 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-847e7fc2-d98b-418d-be88-94a11d7854c7 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:34.196195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-847e7fc2-d98b-418d-be88-94a11d7854c7 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:34.196644 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-847e7fc2-d98b-418d-be88-94a11d7854c7 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:34.197405 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-847e7fc2-d98b-418d-be88-94a11d7854c7 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:34.197831 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-847e7fc2-d98b-418d-be88-94a11d7854c7 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:34.212689 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=100 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:24:34.336701 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-847e7fc2-d98b-418d-be88-94a11d7854c7 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:34.344448 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-847e7fc2-d98b-418d-be88-94a11d7854c7 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1453 microversion: 2.1 time: 0.160041 Jul 04 04:24:34.344987 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 483/949] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:34 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:34.360747 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a6152fca-08cb-4024-bc52-db75ee715272 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:34.361357 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a6152fca-08cb-4024-bc52-db75ee715272 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:34.368051 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a6152fca-08cb-4024-bc52-db75ee715272 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:34.368534 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a6152fca-08cb-4024-bc52-db75ee715272 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:34.369297 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a6152fca-08cb-4024-bc52-db75ee715272 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:34.369730 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a6152fca-08cb-4024-bc52-db75ee715272 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:34.505320 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a6152fca-08cb-4024-bc52-db75ee715272 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:34.513737 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a6152fca-08cb-4024-bc52-db75ee715272 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1453 microversion: 2.1 time: 0.156860 Jul 04 04:24:34.514308 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 467/950] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:34 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:36.251999 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-946f5aa0-3085-4e21-bb95-e45a20191aa8 req-b9e1b39c-c206-4ca6-8e16-48d5506647a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc477aae-9332-481d-bb4f-d1d8ff671c43", "tag": "9a95c8cb-e9e6-4776-92fc-f9a7a4174643"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:24:36.261129 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-946f5aa0-3085-4e21-bb95-e45a20191aa8 req-b9e1b39c-c206-4ca6-8e16-48d5506647a9 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:36.261570 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-946f5aa0-3085-4e21-bb95-e45a20191aa8 req-b9e1b39c-c206-4ca6-8e16-48d5506647a9 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:36.272442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-946f5aa0-3085-4e21-bb95-e45a20191aa8 req-b9e1b39c-c206-4ca6-8e16-48d5506647a9 service nova] Creating event network-changed:9a95c8cb-e9e6-4776-92fc-f9a7a4174643 for instance dc477aae-9332-481d-bb4f-d1d8ff671c43 on hv-cinder-74216 Jul 04 04:24:36.277762 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-946f5aa0-3085-4e21-bb95-e45a20191aa8 req-b9e1b39c-c206-4ca6-8e16-48d5506647a9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029446 Jul 04 04:24:36.278490 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 484/951] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:24:37.095883 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f6beb68f-6a30-4ac2-86c9-eb7f8cdb9fae tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:37.097000 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f6beb68f-6a30-4ac2-86c9-eb7f8cdb9fae tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:37.103853 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6beb68f-6a30-4ac2-86c9-eb7f8cdb9fae tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:37.104646 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6beb68f-6a30-4ac2-86c9-eb7f8cdb9fae tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:37.105441 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6beb68f-6a30-4ac2-86c9-eb7f8cdb9fae tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:37.105881 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6beb68f-6a30-4ac2-86c9-eb7f8cdb9fae tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:37.136144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f6beb68f-6a30-4ac2-86c9-eb7f8cdb9fae tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd/ips" status: 200 len: 150 microversion: 2.1 time: 0.044222 Jul 04 04:24:37.136738 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 468/952] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jul 4 04:24:37 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:24:38.472588 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-410e657e-f05e-4ca6-97b5-646a407d89d5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ecb9262-274d-44da-8532-51c7edabd37d"}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:24:38.473982 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-410e657e-f05e-4ca6-97b5-646a407d89d5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:38.480524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-410e657e-f05e-4ca6-97b5-646a407d89d5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:38.480997 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-410e657e-f05e-4ca6-97b5-646a407d89d5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:38.481767 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-410e657e-f05e-4ca6-97b5-646a407d89d5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:38.482179 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-410e657e-f05e-4ca6-97b5-646a407d89d5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:38.772232 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-410e657e-f05e-4ca6-97b5-646a407d89d5 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "POST /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307219 Jul 04 04:24:38.772984 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 485/953] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jul 4 04:24:38 2022] POST /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:24:46.484924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-facdd7a8-ab8b-49dc-aeb0-9a30483ab5d9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:46.485469 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-facdd7a8-ab8b-49dc-aeb0-9a30483ab5d9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:46.492687 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-facdd7a8-ab8b-49dc-aeb0-9a30483ab5d9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:46.493136 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-facdd7a8-ab8b-49dc-aeb0-9a30483ab5d9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:46.493913 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-facdd7a8-ab8b-49dc-aeb0-9a30483ab5d9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:46.494345 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-facdd7a8-ab8b-49dc-aeb0-9a30483ab5d9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:46.578351 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-facdd7a8-ab8b-49dc-aeb0-9a30483ab5d9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lazy-loading 'services' on Instance uuid eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:24:46.697004 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-facdd7a8-ab8b-49dc-aeb0-9a30483ab5d9 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd/os-volume_attachments/1ecb9262-274d-44da-8532-51c7edabd37d" status: 202 len: 0 microversion: 2.1 time: 0.216120 Jul 04 04:24:46.697593 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 469/954] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jul 4 04:24:46 2022] DELETE /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd/os-volume_attachments/1ecb9262-274d-44da-8532-51c7edabd37d => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:24:46.708540 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-596bb104-fac9-4def-9ed7-eda18de1a4be tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:46.709918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-596bb104-fac9-4def-9ed7-eda18de1a4be tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:46.716629 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-596bb104-fac9-4def-9ed7-eda18de1a4be tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:46.717067 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-596bb104-fac9-4def-9ed7-eda18de1a4be tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:46.717835 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-596bb104-fac9-4def-9ed7-eda18de1a4be tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:46.718266 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-596bb104-fac9-4def-9ed7-eda18de1a4be tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:46.748504 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-596bb104-fac9-4def-9ed7-eda18de1a4be tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046065 Jul 04 04:24:46.749056 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 486/955] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:24:46 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:24:47.763458 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f8438887-bc7f-42b4-ae1e-433349060380 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:47.764778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f8438887-bc7f-42b4-ae1e-433349060380 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:47.772585 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8438887-bc7f-42b4-ae1e-433349060380 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:47.773024 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8438887-bc7f-42b4-ae1e-433349060380 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:47.774765 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8438887-bc7f-42b4-ae1e-433349060380 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:47.775199 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8438887-bc7f-42b4-ae1e-433349060380 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:47.806990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f8438887-bc7f-42b4-ae1e-433349060380 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050389 Jul 04 04:24:47.807544 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 470/956] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:24:47 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:24:48.819592 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a077d125-0afa-47e5-a12c-1b7f9c17b722 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:48.820506 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a077d125-0afa-47e5-a12c-1b7f9c17b722 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:48.823071 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=32 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:24:48.828549 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a077d125-0afa-47e5-a12c-1b7f9c17b722 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:48.828996 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a077d125-0afa-47e5-a12c-1b7f9c17b722 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:48.829753 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a077d125-0afa-47e5-a12c-1b7f9c17b722 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:48.830188 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a077d125-0afa-47e5-a12c-1b7f9c17b722 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:48.859237 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a077d125-0afa-47e5-a12c-1b7f9c17b722 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043784 Jul 04 04:24:48.859782 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 487/957] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:24:48 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 04:24:48.920232 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b7636724-da4e-4e18-a4be-8036bc47f7db tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:48.920787 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b7636724-da4e-4e18-a4be-8036bc47f7db tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:48.931434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7636724-da4e-4e18-a4be-8036bc47f7db tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:48.932038 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7636724-da4e-4e18-a4be-8036bc47f7db tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:48.933211 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7636724-da4e-4e18-a4be-8036bc47f7db tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:48.933732 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7636724-da4e-4e18-a4be-8036bc47f7db tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:48.960573 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b7636724-da4e-4e18-a4be-8036bc47f7db tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:24:49.042103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b7636724-da4e-4e18-a4be-8036bc47f7db tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd" status: 204 len: 0 microversion: 2.1 time: 0.127512 Jul 04 04:24:49.043302 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 471/958] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:24:48 2022] DELETE /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:24:49.054536 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-fb8cb637-d712-4c54-9604-ff9e9913467c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:49.055478 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-fb8cb637-d712-4c54-9604-ff9e9913467c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:49.064495 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fb8cb637-d712-4c54-9604-ff9e9913467c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:49.065222 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fb8cb637-d712-4c54-9604-ff9e9913467c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:49.066254 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fb8cb637-d712-4c54-9604-ff9e9913467c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:49.066866 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fb8cb637-d712-4c54-9604-ff9e9913467c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:49.208452 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-fb8cb637-d712-4c54-9604-ff9e9913467c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:49.216438 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-fb8cb637-d712-4c54-9604-ff9e9913467c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd" status: 200 len: 1681 microversion: 2.1 time: 0.168157 Jul 04 04:24:49.217015 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 488/959] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:49 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:50.239332 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c81576b8-4e2d-4504-b3e4-0fb3b77a79a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:50.240154 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c81576b8-4e2d-4504-b3e4-0fb3b77a79a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:50.247761 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c81576b8-4e2d-4504-b3e4-0fb3b77a79a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:50.248263 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c81576b8-4e2d-4504-b3e4-0fb3b77a79a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:50.249158 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c81576b8-4e2d-4504-b3e4-0fb3b77a79a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:50.249645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c81576b8-4e2d-4504-b3e4-0fb3b77a79a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:50.390135 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c81576b8-4e2d-4504-b3e4-0fb3b77a79a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:50.401825 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c81576b8-4e2d-4504-b3e4-0fb3b77a79a6 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd" status: 200 len: 1681 microversion: 2.1 time: 0.169799 Jul 04 04:24:50.402805 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 472/960] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:50 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:51.422909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-350b0eaf-8695-4994-8cf0-8cb58d852036 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:51.423481 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-350b0eaf-8695-4994-8cf0-8cb58d852036 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:51.430267 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-350b0eaf-8695-4994-8cf0-8cb58d852036 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:51.430774 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-350b0eaf-8695-4994-8cf0-8cb58d852036 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:51.431525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-350b0eaf-8695-4994-8cf0-8cb58d852036 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:51.431964 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-350b0eaf-8695-4994-8cf0-8cb58d852036 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:51.568848 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-350b0eaf-8695-4994-8cf0-8cb58d852036 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:51.577110 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-350b0eaf-8695-4994-8cf0-8cb58d852036 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd" status: 200 len: 1681 microversion: 2.1 time: 0.158034 Jul 04 04:24:51.577575 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 489/961] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:51 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:52.403312 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-d657e980-4b3b-46eb-aece-e74a215379e2 req-156d8518-e6bd-485e-87e5-322e211d0014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd", "name": "network-vif-deleted", "tag": "bca976de-c3c2-454d-b790-aaeab20af040"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:24:52.407759 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:24:52.415467 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-d657e980-4b3b-46eb-aece-e74a215379e2 req-156d8518-e6bd-485e-87e5-322e211d0014 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:52.416688 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-d657e980-4b3b-46eb-aece-e74a215379e2 req-156d8518-e6bd-485e-87e5-322e211d0014 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:52.442217 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-d657e980-4b3b-46eb-aece-e74a215379e2 req-156d8518-e6bd-485e-87e5-322e211d0014 service nova] Creating event network-vif-deleted:bca976de-c3c2-454d-b790-aaeab20af040 for instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd on hv-cinder-74216 Jul 04 04:24:52.451353 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-d657e980-4b3b-46eb-aece-e74a215379e2 req-156d8518-e6bd-485e-87e5-322e211d0014 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051696 Jul 04 04:24:52.452383 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 473/962] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:24:52.596825 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-dee8de53-0fe3-42b4-bc25-f487e1ce6188 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:52.598681 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-dee8de53-0fe3-42b4-bc25-f487e1ce6188 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:52.607248 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dee8de53-0fe3-42b4-bc25-f487e1ce6188 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:52.607701 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dee8de53-0fe3-42b4-bc25-f487e1ce6188 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:52.608725 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dee8de53-0fe3-42b4-bc25-f487e1ce6188 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:52.609156 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dee8de53-0fe3-42b4-bc25-f487e1ce6188 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:52.652739 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dee8de53-0fe3-42b4-bc25-f487e1ce6188 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:52.653184 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dee8de53-0fe3-42b4-bc25-f487e1ce6188 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:52.653637 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.objects.instance [None req-dee8de53-0fe3-42b4-bc25-f487e1ce6188 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lazy-loading 'fault' on Instance uuid eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd {{(pid=117875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:24:52.698517 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-dee8de53-0fe3-42b4-bc25-f487e1ce6188 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4041faa2919d4760ae10907070a10dc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd298eebe6413daaae0d801e902616', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:24:52.706301 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-dee8de53-0fe3-42b4-bc25-f487e1ce6188 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd" status: 200 len: 1330 microversion: 2.1 time: 0.115229 Jul 04 04:24:52.706931 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 490/963] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:52 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd => generated 1330 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:24:53.725047 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0979d482-83d2-4880-ac6e-af97e45636b8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:53.725812 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0979d482-83d2-4880-ac6e-af97e45636b8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:53.734484 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0979d482-83d2-4880-ac6e-af97e45636b8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:53.735259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0979d482-83d2-4880-ac6e-af97e45636b8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:53.736536 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0979d482-83d2-4880-ac6e-af97e45636b8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:53.737313 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0979d482-83d2-4880-ac6e-af97e45636b8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:53.754264 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-0979d482-83d2-4880-ac6e-af97e45636b8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] HTTP exception thrown: Instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd could not be found. Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0979d482-83d2-4880-ac6e-af97e45636b8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Request method failure captured: Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd HTTP/1.1 Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmkvvNXviK4RHs-pC2ZUGxhjzRMF8G1iwt3QQvENmXB_WKs6Un0uo-bkU60UeA5mbFaWI8DULlMS96BRMKHcqOYLorEFYdRp34ZJFtZG4dJDmi0fE-jBVj7rCHrbsjhLZ51yhgpFUDC-ASYnpBPbmkcyUWrK8JyNvv4uGci2lLUQkr4 Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:24:53.756045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:24:53.757664 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ccd298eebe6413daaae0d801e902616", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:24:53.757664 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:53.757664 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:24:53.757664 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:53.757664 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:24:53.757664 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:24:53.757664 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:24:53.757664 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: 4041faa2919d4760ae10907070a10dc7 Jul 04 04:24:53.757664 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:24:53.757664 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:24:53.757664 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd could not be found. Jul 04 04:24:53.757664 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': 'eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd'} Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd could not be found. Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:24:53.758588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:24:53.760447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:24:53.760447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:24:53.760447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:24:53.760447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:24:53.760447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:24:53.760447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:24:53.760447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:24:53.760447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd could not be found. Jul 04 04:24:53.760447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:53.760447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:24:53.760447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:53.760447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:53.760447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:24:53.760447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:24:53.760447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:24:53.760447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:24:53.760447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd could not be found. Jul 04 04:24:53.760447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:53.761878 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0979d482-83d2-4880-ac6e-af97e45636b8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Returning 404 to user: Instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:24:53.761878 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0979d482-83d2-4880-ac6e-af97e45636b8 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd" status: 404 len: 111 microversion: 2.1 time: 0.037555 Jul 04 04:24:53.761878 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 474/964] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:53 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:24:53.767197 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-507c73ab-6fc6-4ed6-acff-afbc2e6fb6bb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '.version_select at 0x7f50c59308b0>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:53.790178 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-507c73ab-6fc6-4ed6-acff-afbc2e6fb6bb tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-745228610" status: 202 len: 0 microversion: 2.1 time: 0.026745 Jul 04 04:24:53.791048 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 491/965] 10.222.0.16 () {58 vars in 1217 bytes} [Mon Jul 4 04:24:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-745228610 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:24:55.570033 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e1f0a7d9-1aae-45ec-9010-d4070fe4992c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:55.570599 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e1f0a7d9-1aae-45ec-9010-d4070fe4992c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:55.577244 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1f0a7d9-1aae-45ec-9010-d4070fe4992c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:55.577692 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1f0a7d9-1aae-45ec-9010-d4070fe4992c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:55.578477 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1f0a7d9-1aae-45ec-9010-d4070fe4992c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:55.578906 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1f0a7d9-1aae-45ec-9010-d4070fe4992c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:55.581534 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:24:55.594529 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-e1f0a7d9-1aae-45ec-9010-d4070fe4992c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] HTTP exception thrown: Instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd could not be found. Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e1f0a7d9-1aae-45ec-9010-d4070fe4992c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Request method failure captured: Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd HTTP/1.1 Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmkvvNXviK4RHs-pC2ZUGxhjzRMF8G1iwt3QQvENmXB_WKs6Un0uo-bkU60UeA5mbFaWI8DULlMS96BRMKHcqOYLorEFYdRp34ZJFtZG4dJDmi0fE-jBVj7rCHrbsjhLZ51yhgpFUDC-ASYnpBPbmkcyUWrK8JyNvv4uGci2lLUQkr4 Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:24:55.596065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:24:55.597418 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ccd298eebe6413daaae0d801e902616", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:24:55.597418 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:55.597418 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:24:55.597418 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:55.597418 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:24:55.597418 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:24:55.597418 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:24:55.597418 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: 4041faa2919d4760ae10907070a10dc7 Jul 04 04:24:55.597418 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:24:55.597418 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:24:55.597418 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd could not be found. Jul 04 04:24:55.597418 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': 'eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd'} Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd could not be found. Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:24:55.598174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd could not be found. Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd could not be found. Jul 04 04:24:55.599704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:55.601665 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e1f0a7d9-1aae-45ec-9010-d4070fe4992c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Returning 404 to user: Instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:24:55.601665 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e1f0a7d9-1aae-45ec-9010-d4070fe4992c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd" status: 404 len: 111 microversion: 2.1 time: 0.031398 Jul 04 04:24:55.601665 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 475/966] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:24:55 2022] DELETE /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:24:55.607543 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ae21ac54-5145-42ff-9943-fce0eeffc766 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:55.608163 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-ae21ac54-5145-42ff-9943-fce0eeffc766 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:55.614970 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ae21ac54-5145-42ff-9943-fce0eeffc766 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:55.615424 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ae21ac54-5145-42ff-9943-fce0eeffc766 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:55.616743 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ae21ac54-5145-42ff-9943-fce0eeffc766 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:55.617190 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ae21ac54-5145-42ff-9943-fce0eeffc766 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:55.631034 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-ae21ac54-5145-42ff-9943-fce0eeffc766 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] HTTP exception thrown: Instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd could not be found. Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ae21ac54-5145-42ff-9943-fce0eeffc766 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Request method failure captured: Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd HTTP/1.1 Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmkvvNXviK4RHs-pC2ZUGxhjzRMF8G1iwt3QQvENmXB_WKs6Un0uo-bkU60UeA5mbFaWI8DULlMS96BRMKHcqOYLorEFYdRp34ZJFtZG4dJDmi0fE-jBVj7rCHrbsjhLZ51yhgpFUDC-ASYnpBPbmkcyUWrK8JyNvv4uGci2lLUQkr4 Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:24:55.633338 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:24:55.635213 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ccd298eebe6413daaae0d801e902616", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:24:55.635213 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:55.635213 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:24:55.635213 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:55.635213 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:24:55.635213 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:24:55.635213 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:24:55.635213 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 4041faa2919d4760ae10907070a10dc7 Jul 04 04:24:55.635213 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:24:55.635213 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:24:55.635213 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd could not be found. Jul 04 04:24:55.635213 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': 'eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd'} Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd could not be found. Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:24:55.636131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:24:55.637599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:24:55.637599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:24:55.637599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:24:55.637599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:24:55.637599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:24:55.637599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:24:55.637599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:24:55.637599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd could not be found. Jul 04 04:24:55.637599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:55.637599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:24:55.637599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:55.637599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:55.637599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:24:55.637599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:24:55.637599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:24:55.637599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:24:55.637599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd could not be found. Jul 04 04:24:55.637599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:55.639104 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ae21ac54-5145-42ff-9943-fce0eeffc766 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Returning 404 to user: Instance eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:24:55.639104 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ae21ac54-5145-42ff-9943-fce0eeffc766 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd" status: 404 len: 111 microversion: 2.1 time: 0.032040 Jul 04 04:24:55.639104 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 492/967] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:55 2022] GET /compute/v2.1/servers/eb5e3a23-dec2-44cb-94d4-5fb615d1e7cd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:24:56.788834 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e097f8b5-1ef1-4e17-bc75-d4c9da4eefaf tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:56.789420 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e097f8b5-1ef1-4e17-bc75-d4c9da4eefaf tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:56.796455 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e097f8b5-1ef1-4e17-bc75-d4c9da4eefaf tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:56.796904 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e097f8b5-1ef1-4e17-bc75-d4c9da4eefaf tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:56.797678 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e097f8b5-1ef1-4e17-bc75-d4c9da4eefaf tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:56.798113 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e097f8b5-1ef1-4e17-bc75-d4c9da4eefaf tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:56.812668 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-e097f8b5-1ef1-4e17-bc75-d4c9da4eefaf tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] HTTP exception thrown: Instance 8504f7ec-3a32-4230-ad65-61da993f52bb could not be found. Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e097f8b5-1ef1-4e17-bc75-d4c9da4eefaf tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Request method failure captured: Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb HTTP/1.1 Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmkvvNXviK4RHs-pC2ZUGxhjzRMF8G1iwt3QQvENmXB_WKs6Un0uo-bkU60UeA5mbFaWI8DULlMS96BRMKHcqOYLorEFYdRp34ZJFtZG4dJDmi0fE-jBVj7rCHrbsjhLZ51yhgpFUDC-ASYnpBPbmkcyUWrK8JyNvv4uGci2lLUQkr4 Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:24:56.814228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:24:56.815711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ccd298eebe6413daaae0d801e902616", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:24:56.815711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:56.815711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:24:56.815711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:56.815711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:24:56.815711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:24:56.815711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:24:56.815711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: 4041faa2919d4760ae10907070a10dc7 Jul 04 04:24:56.815711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:24:56.815711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:24:56.815711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance 8504f7ec-3a32-4230-ad65-61da993f52bb could not be found. Jul 04 04:24:56.815711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': '8504f7ec-3a32-4230-ad65-61da993f52bb'} Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8504f7ec-3a32-4230-ad65-61da993f52bb could not be found. Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:24:56.816460 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8504f7ec-3a32-4230-ad65-61da993f52bb could not be found. Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8504f7ec-3a32-4230-ad65-61da993f52bb could not be found. Jul 04 04:24:56.817870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.819434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e097f8b5-1ef1-4e17-bc75-d4c9da4eefaf tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Returning 404 to user: Instance 8504f7ec-3a32-4230-ad65-61da993f52bb could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:24:56.819434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e097f8b5-1ef1-4e17-bc75-d4c9da4eefaf tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 404 len: 111 microversion: 2.1 time: 0.031210 Jul 04 04:24:56.819434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 476/968] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:24:56 2022] DELETE /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:24:56.825082 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1fe9cf31-b061-4506-a035-a8e4e82d2657 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:56.825696 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-1fe9cf31-b061-4506-a035-a8e4e82d2657 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: 8504f7ec-3a32-4230-ad65-61da993f52bb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:56.832924 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1fe9cf31-b061-4506-a035-a8e4e82d2657 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:56.833389 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1fe9cf31-b061-4506-a035-a8e4e82d2657 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:56.834797 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1fe9cf31-b061-4506-a035-a8e4e82d2657 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:56.835299 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1fe9cf31-b061-4506-a035-a8e4e82d2657 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:56.849958 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-1fe9cf31-b061-4506-a035-a8e4e82d2657 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] HTTP exception thrown: Instance 8504f7ec-3a32-4230-ad65-61da993f52bb could not be found. Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1fe9cf31-b061-4506-a035-a8e4e82d2657 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Request method failure captured: Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb HTTP/1.1 Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmkvvNXviK4RHs-pC2ZUGxhjzRMF8G1iwt3QQvENmXB_WKs6Un0uo-bkU60UeA5mbFaWI8DULlMS96BRMKHcqOYLorEFYdRp34ZJFtZG4dJDmi0fE-jBVj7rCHrbsjhLZ51yhgpFUDC-ASYnpBPbmkcyUWrK8JyNvv4uGci2lLUQkr4 Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:24:56.851555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:24:56.853141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ccd298eebe6413daaae0d801e902616", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:24:56.853141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:56.853141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:24:56.853141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:56.853141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:24:56.853141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:24:56.853141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:24:56.853141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 4041faa2919d4760ae10907070a10dc7 Jul 04 04:24:56.853141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:24:56.853141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:24:56.853141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance 8504f7ec-3a32-4230-ad65-61da993f52bb could not be found. Jul 04 04:24:56.853141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': '8504f7ec-3a32-4230-ad65-61da993f52bb'} Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8504f7ec-3a32-4230-ad65-61da993f52bb could not be found. Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:24:56.854004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:24:56.855239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:24:56.855239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:24:56.855239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:24:56.855239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:24:56.855239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:24:56.855239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:24:56.855239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:24:56.855239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8504f7ec-3a32-4230-ad65-61da993f52bb could not be found. Jul 04 04:24:56.855239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.855239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:24:56.855239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.855239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:56.855239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:24:56.855239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:24:56.855239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:24:56.855239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:24:56.855239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8504f7ec-3a32-4230-ad65-61da993f52bb could not be found. Jul 04 04:24:56.855239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.856280 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1fe9cf31-b061-4506-a035-a8e4e82d2657 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Returning 404 to user: Instance 8504f7ec-3a32-4230-ad65-61da993f52bb could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:24:56.856280 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-1fe9cf31-b061-4506-a035-a8e4e82d2657 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb" status: 404 len: 111 microversion: 2.1 time: 0.032478 Jul 04 04:24:56.856280 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 493/969] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:56 2022] GET /compute/v2.1/servers/8504f7ec-3a32-4230-ad65-61da993f52bb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:24:56.861647 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-504dea05-3b3b-47d9-9b4e-977df4b7396c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:56.862148 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-504dea05-3b3b-47d9-9b4e-977df4b7396c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:56.869140 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-504dea05-3b3b-47d9-9b4e-977df4b7396c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:56.869592 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-504dea05-3b3b-47d9-9b4e-977df4b7396c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:56.870362 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-504dea05-3b3b-47d9-9b4e-977df4b7396c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:56.870852 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-504dea05-3b3b-47d9-9b4e-977df4b7396c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:56.885518 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-504dea05-3b3b-47d9-9b4e-977df4b7396c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] HTTP exception thrown: Instance c03c5904-d825-409f-a638-bb9ce914aec3 could not be found. Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-504dea05-3b3b-47d9-9b4e-977df4b7396c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Request method failure captured: Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 HTTP/1.1 Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmkvvNXviK4RHs-pC2ZUGxhjzRMF8G1iwt3QQvENmXB_WKs6Un0uo-bkU60UeA5mbFaWI8DULlMS96BRMKHcqOYLorEFYdRp34ZJFtZG4dJDmi0fE-jBVj7rCHrbsjhLZ51yhgpFUDC-ASYnpBPbmkcyUWrK8JyNvv4uGci2lLUQkr4 Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:24:56.887080 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:24:56.888662 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ccd298eebe6413daaae0d801e902616", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:24:56.888662 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:56.888662 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:24:56.888662 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:56.888662 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:24:56.888662 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:24:56.888662 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:24:56.888662 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: 4041faa2919d4760ae10907070a10dc7 Jul 04 04:24:56.888662 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:24:56.888662 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:24:56.888662 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance c03c5904-d825-409f-a638-bb9ce914aec3 could not be found. Jul 04 04:24:56.888662 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': 'c03c5904-d825-409f-a638-bb9ce914aec3'} Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c03c5904-d825-409f-a638-bb9ce914aec3 could not be found. Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:24:56.892842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c03c5904-d825-409f-a638-bb9ce914aec3 could not be found. Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c03c5904-d825-409f-a638-bb9ce914aec3 could not be found. Jul 04 04:24:56.895171 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.896702 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-504dea05-3b3b-47d9-9b4e-977df4b7396c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Returning 404 to user: Instance c03c5904-d825-409f-a638-bb9ce914aec3 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:24:56.896702 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-504dea05-3b3b-47d9-9b4e-977df4b7396c tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 404 len: 111 microversion: 2.1 time: 0.030745 Jul 04 04:24:56.896702 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 477/970] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:24:56 2022] DELETE /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:24:56.897190 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c413fda3-d740-48d0-b3fb-501ca9ca3d30 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:56.897798 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c413fda3-d740-48d0-b3fb-501ca9ca3d30 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: c03c5904-d825-409f-a638-bb9ce914aec3] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:56.904163 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c413fda3-d740-48d0-b3fb-501ca9ca3d30 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:56.904614 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c413fda3-d740-48d0-b3fb-501ca9ca3d30 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:56.905379 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c413fda3-d740-48d0-b3fb-501ca9ca3d30 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:56.905813 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c413fda3-d740-48d0-b3fb-501ca9ca3d30 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:56.919598 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-c413fda3-d740-48d0-b3fb-501ca9ca3d30 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] HTTP exception thrown: Instance c03c5904-d825-409f-a638-bb9ce914aec3 could not be found. Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c413fda3-d740-48d0-b3fb-501ca9ca3d30 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Request method failure captured: Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 HTTP/1.1 Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmkvvNXviK4RHs-pC2ZUGxhjzRMF8G1iwt3QQvENmXB_WKs6Un0uo-bkU60UeA5mbFaWI8DULlMS96BRMKHcqOYLorEFYdRp34ZJFtZG4dJDmi0fE-jBVj7rCHrbsjhLZ51yhgpFUDC-ASYnpBPbmkcyUWrK8JyNvv4uGci2lLUQkr4 Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:24:56.921195 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:24:56.922713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ccd298eebe6413daaae0d801e902616", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:24:56.922713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:56.922713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:24:56.922713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:56.922713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:24:56.922713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:24:56.922713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:24:56.922713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 4041faa2919d4760ae10907070a10dc7 Jul 04 04:24:56.922713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:24:56.922713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:24:56.922713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance c03c5904-d825-409f-a638-bb9ce914aec3 could not be found. Jul 04 04:24:56.922713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': 'c03c5904-d825-409f-a638-bb9ce914aec3'} Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c03c5904-d825-409f-a638-bb9ce914aec3 could not be found. Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:24:56.923535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:24:56.924939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:24:56.924939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:24:56.924939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:24:56.924939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:24:56.924939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:24:56.924939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:24:56.924939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:24:56.924939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c03c5904-d825-409f-a638-bb9ce914aec3 could not be found. Jul 04 04:24:56.924939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.924939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:24:56.924939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.924939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:56.924939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:24:56.924939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:24:56.924939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:24:56.924939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:24:56.924939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c03c5904-d825-409f-a638-bb9ce914aec3 could not be found. Jul 04 04:24:56.924939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:56.926193 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c413fda3-d740-48d0-b3fb-501ca9ca3d30 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Returning 404 to user: Instance c03c5904-d825-409f-a638-bb9ce914aec3 could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:24:56.926193 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c413fda3-d740-48d0-b3fb-501ca9ca3d30 tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3" status: 404 len: 111 microversion: 2.1 time: 0.029383 Jul 04 04:24:56.926193 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 494/971] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:56 2022] GET /compute/v2.1/servers/c03c5904-d825-409f-a638-bb9ce914aec3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:24:58.065719 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2fd9842f-3a68-4c6a-b923-1343d9c99b6f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:58.066228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2fd9842f-3a68-4c6a-b923-1343d9c99b6f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:58.073531 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fd9842f-3a68-4c6a-b923-1343d9c99b6f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:58.073978 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fd9842f-3a68-4c6a-b923-1343d9c99b6f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:58.074770 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fd9842f-3a68-4c6a-b923-1343d9c99b6f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:58.075196 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fd9842f-3a68-4c6a-b923-1343d9c99b6f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:58.088976 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-2fd9842f-3a68-4c6a-b923-1343d9c99b6f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] HTTP exception thrown: Instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 could not be found. Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2fd9842f-3a68-4c6a-b923-1343d9c99b6f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Request method failure captured: Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 HTTP/1.1 Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmkvvNXviK4RHs-pC2ZUGxhjzRMF8G1iwt3QQvENmXB_WKs6Un0uo-bkU60UeA5mbFaWI8DULlMS96BRMKHcqOYLorEFYdRp34ZJFtZG4dJDmi0fE-jBVj7rCHrbsjhLZ51yhgpFUDC-ASYnpBPbmkcyUWrK8JyNvv4uGci2lLUQkr4 Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:24:58.090562 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:24:58.092216 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ccd298eebe6413daaae0d801e902616", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:24:58.092216 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:58.092216 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:24:58.092216 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:58.092216 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:24:58.092216 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:24:58.092216 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:24:58.092216 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: 4041faa2919d4760ae10907070a10dc7 Jul 04 04:24:58.092216 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:24:58.092216 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:24:58.092216 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 could not be found. Jul 04 04:24:58.092216 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': 'be90f3f9-d0dd-4296-ba6b-dc719d491a12'} Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 could not be found. Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:24:58.093103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 could not be found. Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 could not be found. Jul 04 04:24:58.094474 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:24:58.095897 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2fd9842f-3a68-4c6a-b923-1343d9c99b6f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Returning 404 to user: Instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:24:58.095897 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2fd9842f-3a68-4c6a-b923-1343d9c99b6f tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "DELETE /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 404 len: 111 microversion: 2.1 time: 0.030194 Jul 04 04:24:58.095897 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 478/972] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:24:58 2022] DELETE /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:24:58.102660 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7246c39c-7fb3-463d-ae80-47026da7bf2e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:24:58.103271 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7246c39c-7fb3-463d-ae80-47026da7bf2e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] [instance: be90f3f9-d0dd-4296-ba6b-dc719d491a12] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:24:58.110282 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7246c39c-7fb3-463d-ae80-47026da7bf2e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:58.110776 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7246c39c-7fb3-463d-ae80-47026da7bf2e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:58.111552 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7246c39c-7fb3-463d-ae80-47026da7bf2e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:24:58.111981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7246c39c-7fb3-463d-ae80-47026da7bf2e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:24:58.131359 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-7246c39c-7fb3-463d-ae80-47026da7bf2e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] HTTP exception thrown: Instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 could not be found. Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7246c39c-7fb3-463d-ae80-47026da7bf2e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Request method failure captured: Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 HTTP/1.1 Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmkvvNXviK4RHs-pC2ZUGxhjzRMF8G1iwt3QQvENmXB_WKs6Un0uo-bkU60UeA5mbFaWI8DULlMS96BRMKHcqOYLorEFYdRp34ZJFtZG4dJDmi0fE-jBVj7rCHrbsjhLZ51yhgpFUDC-ASYnpBPbmkcyUWrK8JyNvv4uGci2lLUQkr4 Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:24:58.133900 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:24:58.136667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7ccd298eebe6413daaae0d801e902616"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7ccd298eebe6413daaae0d801e902616", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:24:58.136667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:58.136667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: 7ccd298eebe6413daaae0d801e902616 Jul 04 04:24:58.136667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1031982349 Jul 04 04:24:58.136667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:24:58.136667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:24:58.136667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:24:58.136667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 4041faa2919d4760ae10907070a10dc7 Jul 04 04:24:58.136667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-AttachVolumeNegativeTest-1031982349-project Jul 04 04:24:58.136667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:24:58.136667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 could not be found. Jul 04 04:24:58.136667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': 'be90f3f9-d0dd-4296-ba6b-dc719d491a12'} Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 could not be found. Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:24:58.137974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:24:58.140247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:24:58.140247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:24:58.140247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:24:58.140247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:24:58.140247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:24:58.140247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:24:58.140247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:24:58.140247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 could not be found. Jul 04 04:24:58.140247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:58.140247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:24:58.140247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:58.140247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:24:58.140247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:24:58.140247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:24:58.140247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:24:58.140247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:24:58.140247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 could not be found. Jul 04 04:24:58.140247 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:24:58.142096 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7246c39c-7fb3-463d-ae80-47026da7bf2e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] Returning 404 to user: Instance be90f3f9-d0dd-4296-ba6b-dc719d491a12 could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:24:58.142096 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7246c39c-7fb3-463d-ae80-47026da7bf2e tempest-AttachVolumeNegativeTest-1031982349 tempest-AttachVolumeNegativeTest-1031982349-project] 10.222.0.16 "GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12" status: 404 len: 111 microversion: 2.1 time: 0.039552 Jul 04 04:24:58.142096 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 495/973] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:24:58 2022] GET /compute/v2.1/servers/be90f3f9-d0dd-4296-ba6b-dc719d491a12 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:25:02.508287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c8e430ce-b770-4583-a8e8-22065e31d1ba tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:02.508929 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c8e430ce-b770-4583-a8e8-22065e31d1ba tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:02.515229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8e430ce-b770-4583-a8e8-22065e31d1ba tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:02.515643 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8e430ce-b770-4583-a8e8-22065e31d1ba tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:02.516420 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8e430ce-b770-4583-a8e8-22065e31d1ba tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:02.516842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8e430ce-b770-4583-a8e8-22065e31d1ba tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:02.600208 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-c8e430ce-b770-4583-a8e8-22065e31d1ba tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lazy-loading 'services' on Instance uuid fb5a126f-e314-44bc-8697-7b07760da296 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:25:02.678638 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c8e430ce-b770-4583-a8e8-22065e31d1ba tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296/os-volume_attachments/b06bf946-c7f9-4118-9a6d-61be85612252" status: 202 len: 0 microversion: 2.1 time: 0.174349 Jul 04 04:25:02.679777 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 479/974] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jul 4 04:25:02 2022] DELETE /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296/os-volume_attachments/b06bf946-c7f9-4118-9a6d-61be85612252 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:25:03.798526 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f7c3017f-5611-4c01-ba31-ed3a9d6a0d48 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:25:03.805468 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f7c3017f-5611-4c01-ba31-ed3a9d6a0d48 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:03.806181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f7c3017f-5611-4c01-ba31-ed3a9d6a0d48 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:03.866572 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f7c3017f-5611-4c01-ba31-ed3a9d6a0d48 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Going to try to stop instance {{(pid=117875) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 04 04:25:03.915519 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-f7c3017f-5611-4c01-ba31-ed3a9d6a0d48 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "POST /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296/action" status: 202 len: 0 microversion: 2.1 time: 0.120720 Jul 04 04:25:03.916017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 496/975] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 4 04:25:03 2022] POST /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:25:03.926000 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d13a4d0e-af34-43e1-954d-7cc1a06aa0e1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:03.927297 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d13a4d0e-af34-43e1-954d-7cc1a06aa0e1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:03.935701 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d13a4d0e-af34-43e1-954d-7cc1a06aa0e1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:03.936209 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d13a4d0e-af34-43e1-954d-7cc1a06aa0e1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:03.937402 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d13a4d0e-af34-43e1-954d-7cc1a06aa0e1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:03.937840 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d13a4d0e-af34-43e1-954d-7cc1a06aa0e1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:04.082463 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d13a4d0e-af34-43e1-954d-7cc1a06aa0e1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:04.090556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d13a4d0e-af34-43e1-954d-7cc1a06aa0e1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1677 microversion: 2.1 time: 0.169189 Jul 04 04:25:04.091120 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 480/976] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:25:03 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:25:05.114023 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-24c6fee9-996f-418f-9739-5c5504992d77 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:05.115086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-24c6fee9-996f-418f-9739-5c5504992d77 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:05.122595 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-24c6fee9-996f-418f-9739-5c5504992d77 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:05.123042 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-24c6fee9-996f-418f-9739-5c5504992d77 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:05.123818 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-24c6fee9-996f-418f-9739-5c5504992d77 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:05.124256 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-24c6fee9-996f-418f-9739-5c5504992d77 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:05.126944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:25:05.263660 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-24c6fee9-996f-418f-9739-5c5504992d77 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:05.276100 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-24c6fee9-996f-418f-9739-5c5504992d77 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1677 microversion: 2.1 time: 0.169809 Jul 04 04:25:05.276897 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 497/977] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:25:05 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:25:06.298397 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-06d8d910-6baf-4fcf-bee4-431ed7c5c0bd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:06.298994 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-06d8d910-6baf-4fcf-bee4-431ed7c5c0bd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:06.315219 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06d8d910-6baf-4fcf-bee4-431ed7c5c0bd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:06.315860 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06d8d910-6baf-4fcf-bee4-431ed7c5c0bd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:06.317061 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06d8d910-6baf-4fcf-bee4-431ed7c5c0bd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:06.317658 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06d8d910-6baf-4fcf-bee4-431ed7c5c0bd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:06.455047 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-06d8d910-6baf-4fcf-bee4-431ed7c5c0bd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:06.462995 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-06d8d910-6baf-4fcf-bee4-431ed7c5c0bd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1677 microversion: 2.1 time: 0.168798 Jul 04 04:25:06.463569 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 481/978] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:25:06 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:25:07.484845 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e408f2e8-52bd-4e14-ad6b-02f27c9d1be9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:07.485693 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e408f2e8-52bd-4e14-ad6b-02f27c9d1be9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:07.497078 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e408f2e8-52bd-4e14-ad6b-02f27c9d1be9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:07.497814 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e408f2e8-52bd-4e14-ad6b-02f27c9d1be9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:07.499147 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e408f2e8-52bd-4e14-ad6b-02f27c9d1be9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:07.499866 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e408f2e8-52bd-4e14-ad6b-02f27c9d1be9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:07.632504 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e408f2e8-52bd-4e14-ad6b-02f27c9d1be9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:07.641242 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e408f2e8-52bd-4e14-ad6b-02f27c9d1be9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1677 microversion: 2.1 time: 0.163118 Jul 04 04:25:07.641817 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 498/979] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:25:07 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:25:08.658966 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c66878cd-e6cc-4545-b8d3-098e065b876d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:08.659546 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c66878cd-e6cc-4545-b8d3-098e065b876d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:08.666797 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c66878cd-e6cc-4545-b8d3-098e065b876d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:08.667247 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c66878cd-e6cc-4545-b8d3-098e065b876d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:08.668011 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c66878cd-e6cc-4545-b8d3-098e065b876d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:08.668435 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c66878cd-e6cc-4545-b8d3-098e065b876d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:08.815919 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c66878cd-e6cc-4545-b8d3-098e065b876d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:08.824012 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c66878cd-e6cc-4545-b8d3-098e065b876d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1677 microversion: 2.1 time: 0.169075 Jul 04 04:25:08.824587 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 482/980] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:25:08 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:25:09.845296 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d26eb528-055f-4e02-8529-f70ea7e88f60 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:09.846354 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d26eb528-055f-4e02-8529-f70ea7e88f60 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:09.856199 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d26eb528-055f-4e02-8529-f70ea7e88f60 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:09.856649 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d26eb528-055f-4e02-8529-f70ea7e88f60 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:09.857411 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d26eb528-055f-4e02-8529-f70ea7e88f60 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:09.857839 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d26eb528-055f-4e02-8529-f70ea7e88f60 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:09.992719 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d26eb528-055f-4e02-8529-f70ea7e88f60 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:10.000585 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d26eb528-055f-4e02-8529-f70ea7e88f60 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1677 microversion: 2.1 time: 0.161872 Jul 04 04:25:10.001125 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 499/981] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:25:09 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:25:11.022910 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3fb416d8-c8c2-4c23-b243-bc78116b1b1d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:11.023911 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3fb416d8-c8c2-4c23-b243-bc78116b1b1d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:11.032075 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3fb416d8-c8c2-4c23-b243-bc78116b1b1d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:11.032533 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3fb416d8-c8c2-4c23-b243-bc78116b1b1d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:11.033403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3fb416d8-c8c2-4c23-b243-bc78116b1b1d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:11.033841 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3fb416d8-c8c2-4c23-b243-bc78116b1b1d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:11.175699 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3fb416d8-c8c2-4c23-b243-bc78116b1b1d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:11.185625 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3fb416d8-c8c2-4c23-b243-bc78116b1b1d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1677 microversion: 2.1 time: 0.169388 Jul 04 04:25:11.186219 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 483/982] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:25:11 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:25:12.204164 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e9a44d76-2a7a-4fc8-bec9-ce6bb87d4ceb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:12.204715 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e9a44d76-2a7a-4fc8-bec9-ce6bb87d4ceb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:12.211577 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e9a44d76-2a7a-4fc8-bec9-ce6bb87d4ceb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:12.212022 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e9a44d76-2a7a-4fc8-bec9-ce6bb87d4ceb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:12.212787 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e9a44d76-2a7a-4fc8-bec9-ce6bb87d4ceb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:12.213215 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e9a44d76-2a7a-4fc8-bec9-ce6bb87d4ceb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:12.346619 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e9a44d76-2a7a-4fc8-bec9-ce6bb87d4ceb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:12.358066 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e9a44d76-2a7a-4fc8-bec9-ce6bb87d4ceb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1677 microversion: 2.1 time: 0.157666 Jul 04 04:25:12.358858 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 500/983] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:25:12 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:25:13.376660 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cfa59258-1e6d-4236-9116-d1c168b4578d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:13.377326 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cfa59258-1e6d-4236-9116-d1c168b4578d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:13.383997 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cfa59258-1e6d-4236-9116-d1c168b4578d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:13.384796 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cfa59258-1e6d-4236-9116-d1c168b4578d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:13.385567 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cfa59258-1e6d-4236-9116-d1c168b4578d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:13.386062 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cfa59258-1e6d-4236-9116-d1c168b4578d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:13.520177 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cfa59258-1e6d-4236-9116-d1c168b4578d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:13.528450 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cfa59258-1e6d-4236-9116-d1c168b4578d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1677 microversion: 2.1 time: 0.155897 Jul 04 04:25:13.529029 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 484/984] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:25:13 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:25:14.546820 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-723de18a-8e8a-4a53-8c96-97fff957991b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:14.547441 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-723de18a-8e8a-4a53-8c96-97fff957991b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:14.554864 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-723de18a-8e8a-4a53-8c96-97fff957991b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:14.555320 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-723de18a-8e8a-4a53-8c96-97fff957991b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:14.556118 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-723de18a-8e8a-4a53-8c96-97fff957991b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:14.556544 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-723de18a-8e8a-4a53-8c96-97fff957991b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:14.691030 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-723de18a-8e8a-4a53-8c96-97fff957991b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:14.699642 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-723de18a-8e8a-4a53-8c96-97fff957991b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1654 microversion: 2.1 time: 0.156970 Jul 04 04:25:14.701823 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 501/985] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:25:14 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1654 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:25:14.716695 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-28fbb8fc-0dd8-43ca-93c7-3ed0e2472aff tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:25:14.723737 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28fbb8fc-0dd8-43ca-93c7-3ed0e2472aff tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:14.724380 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28fbb8fc-0dd8-43ca-93c7-3ed0e2472aff tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:14.747283 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-28fbb8fc-0dd8-43ca-93c7-3ed0e2472aff tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Going to try to start instance {{(pid=117877) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 04 04:25:14.791196 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-28fbb8fc-0dd8-43ca-93c7-3ed0e2472aff tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "POST /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296/action" status: 202 len: 0 microversion: 2.1 time: 0.078056 Jul 04 04:25:14.791812 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 485/986] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 4 04:25:14 2022] POST /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:25:14.800488 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-62dd7ef1-c4cd-4c7b-be20-c975bf304f30 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:14.801394 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-62dd7ef1-c4cd-4c7b-be20-c975bf304f30 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:14.808340 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-62dd7ef1-c4cd-4c7b-be20-c975bf304f30 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:14.809159 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-62dd7ef1-c4cd-4c7b-be20-c975bf304f30 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:14.810262 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-62dd7ef1-c4cd-4c7b-be20-c975bf304f30 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:14.810861 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-62dd7ef1-c4cd-4c7b-be20-c975bf304f30 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:14.967155 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-62dd7ef1-c4cd-4c7b-be20-c975bf304f30 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:14.977881 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-62dd7ef1-c4cd-4c7b-be20-c975bf304f30 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1663 microversion: 2.1 time: 0.180933 Jul 04 04:25:14.978955 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 502/987] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:25:14 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1663 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:25:15.996864 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-94c3f86d-d402-4739-913a-87c5758e0619 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:15.997855 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-94c3f86d-d402-4739-913a-87c5758e0619 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:16.004513 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94c3f86d-d402-4739-913a-87c5758e0619 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:16.004959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94c3f86d-d402-4739-913a-87c5758e0619 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:16.005724 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94c3f86d-d402-4739-913a-87c5758e0619 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:16.006151 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-94c3f86d-d402-4739-913a-87c5758e0619 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:16.142953 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-94c3f86d-d402-4739-913a-87c5758e0619 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:16.150778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-94c3f86d-d402-4739-913a-87c5758e0619 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1663 microversion: 2.1 time: 0.158650 Jul 04 04:25:16.151343 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 486/988] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:25:15 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:25:17.168934 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c150b020-cedf-453d-9d0c-9839bde35cbd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:17.169585 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c150b020-cedf-453d-9d0c-9839bde35cbd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:17.176292 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c150b020-cedf-453d-9d0c-9839bde35cbd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:17.176732 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c150b020-cedf-453d-9d0c-9839bde35cbd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:17.177484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c150b020-cedf-453d-9d0c-9839bde35cbd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:17.177911 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c150b020-cedf-453d-9d0c-9839bde35cbd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:17.309870 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c150b020-cedf-453d-9d0c-9839bde35cbd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:17.318009 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c150b020-cedf-453d-9d0c-9839bde35cbd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1667 microversion: 2.1 time: 0.153235 Jul 04 04:25:17.318644 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 503/989] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:25:17 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:25:42.712684 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-041ef392-9781-489f-9268-fca3ec9f1999 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:42.713873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-041ef392-9781-489f-9268-fca3ec9f1999 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:42.716176 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=27 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:25:42.716986 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:25:42.730351 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-041ef392-9781-489f-9268-fca3ec9f1999 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:42.730889 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-041ef392-9781-489f-9268-fca3ec9f1999 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:42.731638 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-041ef392-9781-489f-9268-fca3ec9f1999 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:42.732209 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-041ef392-9781-489f-9268-fca3ec9f1999 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:42.767421 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-041ef392-9781-489f-9268-fca3ec9f1999 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060810 Jul 04 04:25:42.767983 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 487/990] 10.222.0.16 () {60 vars in 1342 bytes} [Mon Jul 4 04:25:42 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:25:42.828999 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5922c2be-0bfb-4c57-b34c-b24af3b614c1 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:42.829487 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5922c2be-0bfb-4c57-b34c-b24af3b614c1 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:42.831689 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:25:42.832330 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=41 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:25:42.839326 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5922c2be-0bfb-4c57-b34c-b24af3b614c1 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:42.839776 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5922c2be-0bfb-4c57-b34c-b24af3b614c1 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:42.840551 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5922c2be-0bfb-4c57-b34c-b24af3b614c1 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:42.840989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5922c2be-0bfb-4c57-b34c-b24af3b614c1 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:42.867249 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5922c2be-0bfb-4c57-b34c-b24af3b614c1 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Going to try to terminate instance {{(pid=117875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:25:42.950730 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5922c2be-0bfb-4c57-b34c-b24af3b614c1 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 204 len: 0 microversion: 2.20 time: 0.125576 Jul 04 04:25:42.951402 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 504/991] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Jul 4 04:25:42 2022] DELETE /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 04 04:25:42.961604 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7dd78294-f468-4f69-a506-32a3bb76a4b4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:42.962209 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7dd78294-f468-4f69-a506-32a3bb76a4b4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:42.968229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7dd78294-f468-4f69-a506-32a3bb76a4b4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:42.968674 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7dd78294-f468-4f69-a506-32a3bb76a4b4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:42.969436 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7dd78294-f468-4f69-a506-32a3bb76a4b4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:42.969867 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7dd78294-f468-4f69-a506-32a3bb76a4b4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:43.113311 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7dd78294-f468-4f69-a506-32a3bb76a4b4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:43.122609 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7dd78294-f468-4f69-a506-32a3bb76a4b4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:43.124371 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7dd78294-f468-4f69-a506-32a3bb76a4b4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:43.125556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7dd78294-f468-4f69-a506-32a3bb76a4b4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1725 microversion: 2.20 time: 0.169362 Jul 04 04:25:43.126128 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 488/992] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:25:42 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:25:44.144723 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-36950f5d-bedc-4e9f-ab29-e19dd2b4bcf4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:44.145276 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-36950f5d-bedc-4e9f-ab29-e19dd2b4bcf4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:44.152339 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-36950f5d-bedc-4e9f-ab29-e19dd2b4bcf4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:44.152792 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-36950f5d-bedc-4e9f-ab29-e19dd2b4bcf4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:44.153551 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-36950f5d-bedc-4e9f-ab29-e19dd2b4bcf4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:44.153986 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-36950f5d-bedc-4e9f-ab29-e19dd2b4bcf4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:44.296375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-36950f5d-bedc-4e9f-ab29-e19dd2b4bcf4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:44.305131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-36950f5d-bedc-4e9f-ab29-e19dd2b4bcf4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:44.306729 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-36950f5d-bedc-4e9f-ab29-e19dd2b4bcf4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:44.307904 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-36950f5d-bedc-4e9f-ab29-e19dd2b4bcf4 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1725 microversion: 2.20 time: 0.167736 Jul 04 04:25:44.308467 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 505/993] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:25:44 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:25:45.327569 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eb119156-aa71-4a3d-94b9-c9487c924b67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:45.328393 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eb119156-aa71-4a3d-94b9-c9487c924b67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:45.337116 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb119156-aa71-4a3d-94b9-c9487c924b67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:45.337870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb119156-aa71-4a3d-94b9-c9487c924b67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:45.338936 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb119156-aa71-4a3d-94b9-c9487c924b67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:45.339370 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb119156-aa71-4a3d-94b9-c9487c924b67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:45.572048 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eb119156-aa71-4a3d-94b9-c9487c924b67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:45.580642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eb119156-aa71-4a3d-94b9-c9487c924b67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:45.582177 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eb119156-aa71-4a3d-94b9-c9487c924b67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:45.583731 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eb119156-aa71-4a3d-94b9-c9487c924b67 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1725 microversion: 2.20 time: 0.260742 Jul 04 04:25:45.585044 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 489/994] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:25:45 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1725 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:25:46.606670 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-4f3faca3-1d91-4abf-8ab6-63c72823e532 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:46.607456 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-4f3faca3-1d91-4abf-8ab6-63c72823e532 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:46.615964 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4f3faca3-1d91-4abf-8ab6-63c72823e532 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:46.617070 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4f3faca3-1d91-4abf-8ab6-63c72823e532 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:46.618085 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4f3faca3-1d91-4abf-8ab6-63c72823e532 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:46.625478 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4f3faca3-1d91-4abf-8ab6-63c72823e532 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:46.702082 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-4f3faca3-1d91-4abf-8ab6-63c72823e532 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:46.713073 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-4f3faca3-1d91-4abf-8ab6-63c72823e532 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:46.716343 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-4f3faca3-1d91-4abf-8ab6-63c72823e532 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:46.717640 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-4f3faca3-1d91-4abf-8ab6-63c72823e532 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1657 microversion: 2.20 time: 0.115543 Jul 04 04:25:46.721243 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 506/995] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:25:46 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1657 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:25:46.853270 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-6841a66f-18f6-4b90-8b7f-b5644b28e28d req-bd40c6a2-d88b-45e8-b85f-6c80611b61df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb99d59a-d33a-48d2-9824-25f44c1f32c1", "name": "network-vif-deleted", "tag": "f6b7b5f9-dfd8-4f10-99f9-c155d967e2de"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:25:46.863978 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-6841a66f-18f6-4b90-8b7f-b5644b28e28d req-bd40c6a2-d88b-45e8-b85f-6c80611b61df service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:46.864949 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-6841a66f-18f6-4b90-8b7f-b5644b28e28d req-bd40c6a2-d88b-45e8-b85f-6c80611b61df service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:46.885652 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-6841a66f-18f6-4b90-8b7f-b5644b28e28d req-bd40c6a2-d88b-45e8-b85f-6c80611b61df service nova] Creating event network-vif-deleted:f6b7b5f9-dfd8-4f10-99f9-c155d967e2de for instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 on hv-cinder-74216 Jul 04 04:25:46.895716 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-6841a66f-18f6-4b90-8b7f-b5644b28e28d req-bd40c6a2-d88b-45e8-b85f-6c80611b61df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219332 Jul 04 04:25:46.896316 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 490/996] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:25:47.736317 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-be0ea088-6249-4f32-9130-d91d202a345d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:47.736930 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-be0ea088-6249-4f32-9130-d91d202a345d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:47.744041 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-be0ea088-6249-4f32-9130-d91d202a345d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:47.745248 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-be0ea088-6249-4f32-9130-d91d202a345d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:47.746201 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-be0ea088-6249-4f32-9130-d91d202a345d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:47.746733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-be0ea088-6249-4f32-9130-d91d202a345d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:47.785603 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-be0ea088-6249-4f32-9130-d91d202a345d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:47.786691 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-be0ea088-6249-4f32-9130-d91d202a345d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:47.787502 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.objects.instance [None req-be0ea088-6249-4f32-9130-d91d202a345d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lazy-loading 'fault' on Instance uuid fb99d59a-d33a-48d2-9824-25f44c1f32c1 {{(pid=117875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:25:47.836861 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-be0ea088-6249-4f32-9130-d91d202a345d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:47.845218 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-be0ea088-6249-4f32-9130-d91d202a345d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:47.846754 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-be0ea088-6249-4f32-9130-d91d202a345d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e43d573fcf384f65b7382f2d0a01ade4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e83a80c1b34e67958aca6d0a10ba8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:25:47.847989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-be0ea088-6249-4f32-9130-d91d202a345d tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 200 len: 1372 microversion: 2.20 time: 0.115688 Jul 04 04:25:47.848566 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 507/997] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:25:47 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 1372 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 04:25:48.867422 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9cc768ec-f9e4-4137-93c5-f323293c4db7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:48.868050 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9cc768ec-f9e4-4137-93c5-f323293c4db7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:48.875500 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9cc768ec-f9e4-4137-93c5-f323293c4db7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:48.875929 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9cc768ec-f9e4-4137-93c5-f323293c4db7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:48.876751 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9cc768ec-f9e4-4137-93c5-f323293c4db7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:48.877191 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9cc768ec-f9e4-4137-93c5-f323293c4db7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:48.891923 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-9cc768ec-f9e4-4137-93c5-f323293c4db7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] HTTP exception thrown: Instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 could not be found. Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9cc768ec-f9e4-4137-93c5-f323293c4db7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Request method failure captured: Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 HTTP/1.1 Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmnArG0gFq-Mhp0LfDDk7PvWs0b-E4X7JpMTm6wY2R8S_kcEYz19NDkLFuif9LYPPYIiEgr2zN2Gac_0iF1l7ppB9yWX4IRGfCpcokDIw_hpibe7DDNOnDsMzVq75O9vXj5QVB_Z0ILJrBraJqKwg05FWQWFRKG-u--0b0-nmb2spUU Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 77e83a80c1b34e67958aca6d0a10ba8a Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-687534770 Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:25:48.893526 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:25:48.895200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77e83a80c1b34e67958aca6d0a10ba8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/77e83a80c1b34e67958aca6d0a10ba8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77e83a80c1b34e67958aca6d0a10ba8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_77e83a80c1b34e67958aca6d0a10ba8a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:25:48.895200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-687534770 Jul 04 04:25:48.895200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 77e83a80c1b34e67958aca6d0a10ba8a Jul 04 04:25:48.895200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-687534770 Jul 04 04:25:48.895200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeShelveTestJSON-687534770-project Jul 04 04:25:48.895200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:25:48.895200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:25:48.895200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: e43d573fcf384f65b7382f2d0a01ade4 Jul 04 04:25:48.895200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-687534770-project Jul 04 04:25:48.895200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:25:48.895200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 could not be found. Jul 04 04:25:48.895200 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': 'fb99d59a-d33a-48d2-9824-25f44c1f32c1'} Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 could not be found. Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:25:48.896114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:25:48.897959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:25:48.897959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:25:48.897959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:25:48.897959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:25:48.897959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:25:48.897959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:25:48.897959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:25:48.897959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 could not be found. Jul 04 04:25:48.897959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:25:48.897959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:25:48.897959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:25:48.897959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:25:48.897959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:25:48.897959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:25:48.897959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:25:48.897959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:25:48.897959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 could not be found. Jul 04 04:25:48.897959 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:25:48.899392 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9cc768ec-f9e4-4137-93c5-f323293c4db7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Returning 404 to user: Instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:25:48.899392 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9cc768ec-f9e4-4137-93c5-f323293c4db7 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 404 len: 111 microversion: 2.20 time: 0.032856 Jul 04 04:25:48.899392 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 491/998] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:25:48 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 04:25:48.904744 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e979d906-c584-46a5-b8c2-a499ca25acc3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '.version_select at 0x7f50c0ff9c10>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:48.924986 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e979d906-c584-46a5-b8c2-a499ca25acc3 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422019908" status: 204 len: 0 microversion: 2.20 time: 0.024102 Jul 04 04:25:48.925554 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 508/999] 10.222.0.16 () {60 vars in 1261 bytes} [Mon Jul 4 04:25:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422019908 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 04 04:25:50.718345 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5c0ba82c-9b8c-4cc1-bd0c-42c0a35bc109 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:50.718892 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5c0ba82c-9b8c-4cc1-bd0c-42c0a35bc109 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:50.725723 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c0ba82c-9b8c-4cc1-bd0c-42c0a35bc109 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:50.726187 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c0ba82c-9b8c-4cc1-bd0c-42c0a35bc109 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:50.726985 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c0ba82c-9b8c-4cc1-bd0c-42c0a35bc109 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:50.727412 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c0ba82c-9b8c-4cc1-bd0c-42c0a35bc109 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:50.741065 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-5c0ba82c-9b8c-4cc1-bd0c-42c0a35bc109 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] HTTP exception thrown: Instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 could not be found. Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5c0ba82c-9b8c-4cc1-bd0c-42c0a35bc109 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Request method failure captured: Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 HTTP/1.1 Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmnArG0gFq-Mhp0LfDDk7PvWs0b-E4X7JpMTm6wY2R8S_kcEYz19NDkLFuif9LYPPYIiEgr2zN2Gac_0iF1l7ppB9yWX4IRGfCpcokDIw_hpibe7DDNOnDsMzVq75O9vXj5QVB_Z0ILJrBraJqKwg05FWQWFRKG-u--0b0-nmb2spUU Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 77e83a80c1b34e67958aca6d0a10ba8a Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-687534770 Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:25:50.742940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:25:50.744585 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77e83a80c1b34e67958aca6d0a10ba8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/77e83a80c1b34e67958aca6d0a10ba8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77e83a80c1b34e67958aca6d0a10ba8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_77e83a80c1b34e67958aca6d0a10ba8a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:25:50.744585 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-687534770 Jul 04 04:25:50.744585 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 77e83a80c1b34e67958aca6d0a10ba8a Jul 04 04:25:50.744585 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-687534770 Jul 04 04:25:50.744585 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeShelveTestJSON-687534770-project Jul 04 04:25:50.744585 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:25:50.744585 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:25:50.744585 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: e43d573fcf384f65b7382f2d0a01ade4 Jul 04 04:25:50.744585 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-687534770-project Jul 04 04:25:50.744585 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:25:50.744585 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 could not be found. Jul 04 04:25:50.744585 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': 'fb99d59a-d33a-48d2-9824-25f44c1f32c1'} Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 could not be found. Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:25:50.745457 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 could not be found. Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 could not be found. Jul 04 04:25:50.746924 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:25:50.748443 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5c0ba82c-9b8c-4cc1-bd0c-42c0a35bc109 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Returning 404 to user: Instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:25:50.748443 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5c0ba82c-9b8c-4cc1-bd0c-42c0a35bc109 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 404 len: 111 microversion: 2.20 time: 0.029958 Jul 04 04:25:50.748443 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 492/1000] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Jul 4 04:25:50 2022] DELETE /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 04:25:50.753571 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-2344c148-816e-45ec-8dfa-5cf6f5b24497 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:50.754519 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-2344c148-816e-45ec-8dfa-5cf6f5b24497 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: fb99d59a-d33a-48d2-9824-25f44c1f32c1] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:50.763363 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2344c148-816e-45ec-8dfa-5cf6f5b24497 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:50.763820 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2344c148-816e-45ec-8dfa-5cf6f5b24497 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:50.764601 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2344c148-816e-45ec-8dfa-5cf6f5b24497 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:50.765040 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2344c148-816e-45ec-8dfa-5cf6f5b24497 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:50.778992 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-2344c148-816e-45ec-8dfa-5cf6f5b24497 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] HTTP exception thrown: Instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 could not be found. Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-2344c148-816e-45ec-8dfa-5cf6f5b24497 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Request method failure captured: Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 HTTP/1.1 Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmnArG0gFq-Mhp0LfDDk7PvWs0b-E4X7JpMTm6wY2R8S_kcEYz19NDkLFuif9LYPPYIiEgr2zN2Gac_0iF1l7ppB9yWX4IRGfCpcokDIw_hpibe7DDNOnDsMzVq75O9vXj5QVB_Z0ILJrBraJqKwg05FWQWFRKG-u--0b0-nmb2spUU Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: 77e83a80c1b34e67958aca6d0a10ba8a Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-687534770 Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:25:50.780733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:25:50.782438 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77e83a80c1b34e67958aca6d0a10ba8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/77e83a80c1b34e67958aca6d0a10ba8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77e83a80c1b34e67958aca6d0a10ba8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_77e83a80c1b34e67958aca6d0a10ba8a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:25:50.782438 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-AttachVolumeShelveTestJSON-687534770 Jul 04 04:25:50.782438 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: 77e83a80c1b34e67958aca6d0a10ba8a Jul 04 04:25:50.782438 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-687534770 Jul 04 04:25:50.782438 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-AttachVolumeShelveTestJSON-687534770-project Jul 04 04:25:50.782438 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:25:50.782438 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:25:50.782438 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: e43d573fcf384f65b7382f2d0a01ade4 Jul 04 04:25:50.782438 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-AttachVolumeShelveTestJSON-687534770-project Jul 04 04:25:50.782438 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:25:50.782438 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 could not be found. Jul 04 04:25:50.782438 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': 'fb99d59a-d33a-48d2-9824-25f44c1f32c1'} Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 could not be found. Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:25:50.783311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:25:50.784777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:25:50.784777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:25:50.784777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:25:50.784777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:25:50.784777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:25:50.784777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:25:50.784777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:25:50.784777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 could not be found. Jul 04 04:25:50.784777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:25:50.784777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:25:50.784777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:25:50.784777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:25:50.784777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:25:50.784777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:25:50.784777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:25:50.784777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:25:50.784777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 could not be found. Jul 04 04:25:50.784777 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:25:50.786237 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-2344c148-816e-45ec-8dfa-5cf6f5b24497 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Returning 404 to user: Instance fb99d59a-d33a-48d2-9824-25f44c1f32c1 could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:25:50.786237 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-2344c148-816e-45ec-8dfa-5cf6f5b24497 tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1" status: 404 len: 111 microversion: 2.20 time: 0.033309 Jul 04 04:25:50.786237 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 509/1001] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:25:50 2022] GET /compute/v2.1/servers/fb99d59a-d33a-48d2-9824-25f44c1f32c1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 04 04:25:51.923543 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4cd78949-45a7-42dd-9c89-a7f2265b5dff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:51.924636 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4cd78949-45a7-42dd-9c89-a7f2265b5dff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:51.931519 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cd78949-45a7-42dd-9c89-a7f2265b5dff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:51.931999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cd78949-45a7-42dd-9c89-a7f2265b5dff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:51.932799 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cd78949-45a7-42dd-9c89-a7f2265b5dff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:51.933373 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4cd78949-45a7-42dd-9c89-a7f2265b5dff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:51.949652 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-4cd78949-45a7-42dd-9c89-a7f2265b5dff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] HTTP exception thrown: Instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 could not be found. Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4cd78949-45a7-42dd-9c89-a7f2265b5dff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Request method failure captured: Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 HTTP/1.1 Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmnArG0gFq-Mhp0LfDDk7PvWs0b-E4X7JpMTm6wY2R8S_kcEYz19NDkLFuif9LYPPYIiEgr2zN2Gac_0iF1l7ppB9yWX4IRGfCpcokDIw_hpibe7DDNOnDsMzVq75O9vXj5QVB_Z0ILJrBraJqKwg05FWQWFRKG-u--0b0-nmb2spUU Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 77e83a80c1b34e67958aca6d0a10ba8a Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-687534770 Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:25:51.951403 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:25:51.952973 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77e83a80c1b34e67958aca6d0a10ba8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/77e83a80c1b34e67958aca6d0a10ba8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77e83a80c1b34e67958aca6d0a10ba8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_77e83a80c1b34e67958aca6d0a10ba8a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:25:51.952973 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-687534770 Jul 04 04:25:51.952973 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 77e83a80c1b34e67958aca6d0a10ba8a Jul 04 04:25:51.952973 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-687534770 Jul 04 04:25:51.952973 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeShelveTestJSON-687534770-project Jul 04 04:25:51.952973 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:25:51.952973 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:25:51.952973 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: e43d573fcf384f65b7382f2d0a01ade4 Jul 04 04:25:51.952973 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-687534770-project Jul 04 04:25:51.952973 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:25:51.952973 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 could not be found. Jul 04 04:25:51.952973 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': 'c6e151ec-4f75-4bfe-8c27-3d6ac7c72453'} Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 could not be found. Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:25:51.953783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 could not be found. Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 could not be found. Jul 04 04:25:51.955130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:25:51.956521 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4cd78949-45a7-42dd-9c89-a7f2265b5dff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Returning 404 to user: Instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:25:51.956521 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4cd78949-45a7-42dd-9c89-a7f2265b5dff tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 404 len: 111 microversion: 2.20 time: 0.033258 Jul 04 04:25:51.956521 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 493/1002] 10.222.0.16 () {60 vars in 1279 bytes} [Mon Jul 4 04:25:51 2022] DELETE /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 04:25:51.961473 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f545f492-2406-4610-89cd-d205de0ce60e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:25:51.962120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f545f492-2406-4610-89cd-d205de0ce60e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] [instance: c6e151ec-4f75-4bfe-8c27-3d6ac7c72453] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:25:51.969251 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f545f492-2406-4610-89cd-d205de0ce60e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:51.969698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f545f492-2406-4610-89cd-d205de0ce60e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:51.970501 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f545f492-2406-4610-89cd-d205de0ce60e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:25:51.970939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f545f492-2406-4610-89cd-d205de0ce60e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:25:51.988479 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-f545f492-2406-4610-89cd-d205de0ce60e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] HTTP exception thrown: Instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 could not be found. Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f545f492-2406-4610-89cd-d205de0ce60e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Request method failure captured: Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 HTTP/1.1 Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmnArG0gFq-Mhp0LfDDk7PvWs0b-E4X7JpMTm6wY2R8S_kcEYz19NDkLFuif9LYPPYIiEgr2zN2Gac_0iF1l7ppB9yWX4IRGfCpcokDIw_hpibe7DDNOnDsMzVq75O9vXj5QVB_Z0ILJrBraJqKwg05FWQWFRKG-u--0b0-nmb2spUU Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: 77e83a80c1b34e67958aca6d0a10ba8a Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-687534770 Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:25:51.990097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:25:51.991766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77e83a80c1b34e67958aca6d0a10ba8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/77e83a80c1b34e67958aca6d0a10ba8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77e83a80c1b34e67958aca6d0a10ba8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_77e83a80c1b34e67958aca6d0a10ba8a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:25:51.991766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-AttachVolumeShelveTestJSON-687534770 Jul 04 04:25:51.991766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: 77e83a80c1b34e67958aca6d0a10ba8a Jul 04 04:25:51.991766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-687534770 Jul 04 04:25:51.991766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-AttachVolumeShelveTestJSON-687534770-project Jul 04 04:25:51.991766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:25:51.991766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:25:51.991766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: e43d573fcf384f65b7382f2d0a01ade4 Jul 04 04:25:51.991766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-AttachVolumeShelveTestJSON-687534770-project Jul 04 04:25:51.991766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:25:51.991766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 could not be found. Jul 04 04:25:51.991766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': 'c6e151ec-4f75-4bfe-8c27-3d6ac7c72453'} Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 could not be found. Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:25:51.992590 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:25:51.993790 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:25:51.993790 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:25:51.993790 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:25:51.993790 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:25:51.993790 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:25:51.993790 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:25:51.993790 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:25:51.993790 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 could not be found. Jul 04 04:25:51.993790 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:25:51.993790 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:25:51.993790 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:25:51.993790 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:25:51.993790 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:25:51.993790 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:25:51.993790 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:25:51.993790 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:25:51.993790 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 could not be found. Jul 04 04:25:51.993790 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:25:51.994866 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f545f492-2406-4610-89cd-d205de0ce60e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] Returning 404 to user: Instance c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:25:51.994866 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-f545f492-2406-4610-89cd-d205de0ce60e tempest-AttachVolumeShelveTestJSON-687534770 tempest-AttachVolumeShelveTestJSON-687534770-project] 10.222.0.16 "GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453" status: 404 len: 111 microversion: 2.20 time: 0.034005 Jul 04 04:25:51.994866 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 510/1003] 10.222.0.16 () {60 vars in 1276 bytes} [Mon Jul 4 04:25:51 2022] GET /compute/v2.1/servers/c6e151ec-4f75-4bfe-8c27-3d6ac7c72453 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 04:26:14.781362 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=14 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:26:14.782160 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=26 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:26:14.786410 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a5139787-ad29-4787-aadc-25023ebedf57 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1245973049", "imageRef": "46b9937d-f997-401a-a3aa-bb9028764454", "flavorRef": "452", "networks": [{"uuid": "72171f11-8631-4b27-9aa8-5cd98daeeeb4"}]}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:26:14.849642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-a5139787-ad29-4787-aadc-25023ebedf57 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] validate_networks() for [('72171f11-8631-4b27-9aa8-5cd98daeeeb4', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:26:15.289884 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-a5139787-ad29-4787-aadc-25023ebedf57 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:26:15.290555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-a5139787-ad29-4787-aadc-25023ebedf57 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:26:15.291241 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-a5139787-ad29-4787-aadc-25023ebedf57 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:26:15.291849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-a5139787-ad29-4787-aadc-25023ebedf57 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:26:15.292425 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-a5139787-ad29-4787-aadc-25023ebedf57 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:26:15.306443 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5139787-ad29-4787-aadc-25023ebedf57 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:15.307093 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5139787-ad29-4787-aadc-25023ebedf57 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:15.307905 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5139787-ad29-4787-aadc-25023ebedf57 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:15.308333 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5139787-ad29-4787-aadc-25023ebedf57 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:15.328324 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-a5139787-ad29-4787-aadc-25023ebedf57 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Getting quotas for project d770140713d34c5ab7c8775e5e9837fa. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:26:15.332642 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-a5139787-ad29-4787-aadc-25023ebedf57 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Getting quotas for user 3f505d44f601474aafa4ee57e71588a7 and project d770140713d34c5ab7c8775e5e9837fa. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:26:15.343735 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a5139787-ad29-4787-aadc-25023ebedf57 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:26:15.346058 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a5139787-ad29-4787-aadc-25023ebedf57 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46b9937d-f997-401a-a3aa-bb9028764454',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:26:15.393612 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a5139787-ad29-4787-aadc-25023ebedf57 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613518 Jul 04 04:26:15.394295 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 494/1004] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:26:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 04:26:15.405618 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-77f6bf4f-41d4-47cd-8754-9ab157a6d209 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:15.406179 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-77f6bf4f-41d4-47cd-8754-9ab157a6d209 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:15.410072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:26:15.410764 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:26:15.464765 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-77f6bf4f-41d4-47cd-8754-9ab157a6d209 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:15.471660 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-77f6bf4f-41d4-47cd-8754-9ab157a6d209 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb" status: 200 len: 1214 microversion: 2.1 time: 0.070842 Jul 04 04:26:15.472224 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 511/1005] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:15 2022] GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:16.490199 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ab476c3a-f898-4b97-bea2-371b865bf59f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:16.490897 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ab476c3a-f898-4b97-bea2-371b865bf59f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:16.497613 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab476c3a-f898-4b97-bea2-371b865bf59f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:16.498088 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab476c3a-f898-4b97-bea2-371b865bf59f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:16.498882 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab476c3a-f898-4b97-bea2-371b865bf59f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:16.499431 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab476c3a-f898-4b97-bea2-371b865bf59f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:16.585997 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ab476c3a-f898-4b97-bea2-371b865bf59f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:16.594604 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ab476c3a-f898-4b97-bea2-371b865bf59f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb" status: 200 len: 1274 microversion: 2.1 time: 0.110007 Jul 04 04:26:16.595192 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 495/1006] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:16 2022] GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb => generated 1274 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:17.612941 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-20ad381c-d3c8-4f26-8882-fbc7ad7e4722 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:17.613578 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-20ad381c-d3c8-4f26-8882-fbc7ad7e4722 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:17.620434 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-20ad381c-d3c8-4f26-8882-fbc7ad7e4722 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:17.620883 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-20ad381c-d3c8-4f26-8882-fbc7ad7e4722 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:17.621656 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-20ad381c-d3c8-4f26-8882-fbc7ad7e4722 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:17.622109 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-20ad381c-d3c8-4f26-8882-fbc7ad7e4722 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:17.758089 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-20ad381c-d3c8-4f26-8882-fbc7ad7e4722 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:17.766174 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-20ad381c-d3c8-4f26-8882-fbc7ad7e4722 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb" status: 200 len: 1314 microversion: 2.1 time: 0.157434 Jul 04 04:26:17.766991 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 512/1007] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:17 2022] GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:17.939560 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-3aeeeab2-176c-4d55-8abd-6a02854b4d54 req-06db79ec-dea0-470d-b5cc-d5615f1ff32c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb", "tag": "36d5a35c-ec51-4bd4-860c-705100cca559"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:26:17.949695 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-3aeeeab2-176c-4d55-8abd-6a02854b4d54 req-06db79ec-dea0-470d-b5cc-d5615f1ff32c service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:17.950346 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-3aeeeab2-176c-4d55-8abd-6a02854b4d54 req-06db79ec-dea0-470d-b5cc-d5615f1ff32c service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:17.964048 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-3aeeeab2-176c-4d55-8abd-6a02854b4d54 req-06db79ec-dea0-470d-b5cc-d5615f1ff32c service nova] Creating event network-changed:36d5a35c-ec51-4bd4-860c-705100cca559 for instance d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb on hv-cinder-74216 Jul 04 04:26:17.969153 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-3aeeeab2-176c-4d55-8abd-6a02854b4d54 req-06db79ec-dea0-470d-b5cc-d5615f1ff32c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035557 Jul 04 04:26:17.969917 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 496/1008] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:26:18.785009 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-fdbdf313-3475-47f0-9256-8b0e5724d9c0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:18.785751 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-fdbdf313-3475-47f0-9256-8b0e5724d9c0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:18.794206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fdbdf313-3475-47f0-9256-8b0e5724d9c0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:18.794686 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fdbdf313-3475-47f0-9256-8b0e5724d9c0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:18.795481 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fdbdf313-3475-47f0-9256-8b0e5724d9c0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:18.795908 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fdbdf313-3475-47f0-9256-8b0e5724d9c0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:18.936067 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-fdbdf313-3475-47f0-9256-8b0e5724d9c0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:18.944637 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-fdbdf313-3475-47f0-9256-8b0e5724d9c0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb" status: 200 len: 1314 microversion: 2.1 time: 0.164149 Jul 04 04:26:18.945222 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 513/1009] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:18 2022] GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:19.967284 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c51ac5e2-ca0f-4fbb-9cb0-93a495a241a8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:19.968454 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c51ac5e2-ca0f-4fbb-9cb0-93a495a241a8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:19.976313 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c51ac5e2-ca0f-4fbb-9cb0-93a495a241a8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:19.976755 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c51ac5e2-ca0f-4fbb-9cb0-93a495a241a8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:19.977524 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c51ac5e2-ca0f-4fbb-9cb0-93a495a241a8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:19.977962 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c51ac5e2-ca0f-4fbb-9cb0-93a495a241a8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:20.117579 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c51ac5e2-ca0f-4fbb-9cb0-93a495a241a8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:20.128569 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c51ac5e2-ca0f-4fbb-9cb0-93a495a241a8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb" status: 200 len: 1314 microversion: 2.1 time: 0.169154 Jul 04 04:26:20.129155 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 497/1010] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:19 2022] GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:21.148763 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c601426a-8285-4978-8884-720721bc6c9c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:21.150587 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c601426a-8285-4978-8884-720721bc6c9c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:21.158647 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c601426a-8285-4978-8884-720721bc6c9c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:21.159096 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c601426a-8285-4978-8884-720721bc6c9c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:21.159926 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c601426a-8285-4978-8884-720721bc6c9c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:21.160359 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c601426a-8285-4978-8884-720721bc6c9c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:21.384359 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c601426a-8285-4978-8884-720721bc6c9c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:21.393184 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c601426a-8285-4978-8884-720721bc6c9c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb" status: 200 len: 1314 microversion: 2.1 time: 0.248939 Jul 04 04:26:21.393764 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 514/1011] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:21 2022] GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:22.411501 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b944ccea-8d4d-4a4d-a755-660e46cd970e tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:22.412560 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b944ccea-8d4d-4a4d-a755-660e46cd970e tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:22.418671 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b944ccea-8d4d-4a4d-a755-660e46cd970e tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:22.419113 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b944ccea-8d4d-4a4d-a755-660e46cd970e tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:22.419879 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b944ccea-8d4d-4a4d-a755-660e46cd970e tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:22.420298 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b944ccea-8d4d-4a4d-a755-660e46cd970e tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:22.562932 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b944ccea-8d4d-4a4d-a755-660e46cd970e tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:22.570606 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b944ccea-8d4d-4a4d-a755-660e46cd970e tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb" status: 200 len: 1314 microversion: 2.1 time: 0.165075 Jul 04 04:26:22.571173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 498/1012] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:22 2022] GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:23.587963 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-bbf2f640-c1dc-45cf-ac66-6305351c3f2e tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:23.588546 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-bbf2f640-c1dc-45cf-ac66-6305351c3f2e tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:23.595125 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bbf2f640-c1dc-45cf-ac66-6305351c3f2e tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:23.595604 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bbf2f640-c1dc-45cf-ac66-6305351c3f2e tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:23.596890 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bbf2f640-c1dc-45cf-ac66-6305351c3f2e tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:23.597343 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bbf2f640-c1dc-45cf-ac66-6305351c3f2e tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:23.734174 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-bbf2f640-c1dc-45cf-ac66-6305351c3f2e tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:23.742659 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-bbf2f640-c1dc-45cf-ac66-6305351c3f2e tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb" status: 200 len: 1314 microversion: 2.1 time: 0.158729 Jul 04 04:26:23.743238 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 515/1013] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:23 2022] GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:24.276863 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-04107e5f-ff12-4e12-af7d-8c48b96f279b req-66b4c73a-65aa-4872-b423-06cf2bbfa0fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb", "name": "network-vif-plugged", "status": "completed", "tag": "36d5a35c-ec51-4bd4-860c-705100cca559"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:26:24.287164 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-04107e5f-ff12-4e12-af7d-8c48b96f279b req-66b4c73a-65aa-4872-b423-06cf2bbfa0fb service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:24.287598 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-04107e5f-ff12-4e12-af7d-8c48b96f279b req-66b4c73a-65aa-4872-b423-06cf2bbfa0fb service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:24.298393 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-04107e5f-ff12-4e12-af7d-8c48b96f279b req-66b4c73a-65aa-4872-b423-06cf2bbfa0fb service nova] Creating event network-vif-plugged:36d5a35c-ec51-4bd4-860c-705100cca559 for instance d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb on hv-cinder-74216 Jul 04 04:26:24.303589 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-04107e5f-ff12-4e12-af7d-8c48b96f279b req-66b4c73a-65aa-4872-b423-06cf2bbfa0fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154274 Jul 04 04:26:24.304164 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 499/1014] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:26:24.759551 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9970e70c-8218-48a7-97d8-5553897cb15a tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:24.760087 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-9970e70c-8218-48a7-97d8-5553897cb15a tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:24.767080 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9970e70c-8218-48a7-97d8-5553897cb15a tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:24.767841 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9970e70c-8218-48a7-97d8-5553897cb15a tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:24.768749 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9970e70c-8218-48a7-97d8-5553897cb15a tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:24.769218 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9970e70c-8218-48a7-97d8-5553897cb15a tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:24.908534 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9970e70c-8218-48a7-97d8-5553897cb15a tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:24.917867 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9970e70c-8218-48a7-97d8-5553897cb15a tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb" status: 200 len: 1314 microversion: 2.1 time: 0.162604 Jul 04 04:26:24.918487 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 516/1015] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:24 2022] GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:25.934275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:26:25.935296 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=6 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:26:25.940630 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-969d4fe9-ed69-43c1-8a40-f58b940006aa tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:25.941327 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-969d4fe9-ed69-43c1-8a40-f58b940006aa tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:25.948643 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-969d4fe9-ed69-43c1-8a40-f58b940006aa tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:25.949094 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-969d4fe9-ed69-43c1-8a40-f58b940006aa tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:25.949856 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-969d4fe9-ed69-43c1-8a40-f58b940006aa tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:25.950319 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-969d4fe9-ed69-43c1-8a40-f58b940006aa tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:26.101581 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-969d4fe9-ed69-43c1-8a40-f58b940006aa tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:26.109182 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-969d4fe9-ed69-43c1-8a40-f58b940006aa tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb" status: 200 len: 1314 microversion: 2.1 time: 0.177458 Jul 04 04:26:26.109769 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 500/1016] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:25 2022] GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:27.125924 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5559c3f1-3399-4e39-97a1-600a88d0f2b8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:27.126545 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5559c3f1-3399-4e39-97a1-600a88d0f2b8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:27.128569 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=2 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:26:27.134810 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5559c3f1-3399-4e39-97a1-600a88d0f2b8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:27.135241 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5559c3f1-3399-4e39-97a1-600a88d0f2b8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:27.135996 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5559c3f1-3399-4e39-97a1-600a88d0f2b8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:27.136539 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5559c3f1-3399-4e39-97a1-600a88d0f2b8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:27.291050 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5559c3f1-3399-4e39-97a1-600a88d0f2b8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:27.299776 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5559c3f1-3399-4e39-97a1-600a88d0f2b8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb" status: 200 len: 1498 microversion: 2.1 time: 0.177589 Jul 04 04:26:27.300343 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 517/1017] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:27 2022] GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb => generated 1498 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:27.803275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c7872fb9-8112-4009-aeab-b962737c99c7 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:27.803798 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c7872fb9-8112-4009-aeab-b962737c99c7 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:27.811376 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7872fb9-8112-4009-aeab-b962737c99c7 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:27.812037 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7872fb9-8112-4009-aeab-b962737c99c7 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:27.812897 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7872fb9-8112-4009-aeab-b962737c99c7 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:27.813331 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7872fb9-8112-4009-aeab-b962737c99c7 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:27.840357 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c7872fb9-8112-4009-aeab-b962737c99c7 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:26:27.938147 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c7872fb9-8112-4009-aeab-b962737c99c7 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb" status: 204 len: 0 microversion: 2.1 time: 0.138004 Jul 04 04:26:27.939420 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 501/1018] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:26:27 2022] DELETE /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:26:27.950158 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e696150f-fdcb-4da4-8c77-9a2e2c58a8d6 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:27.951077 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e696150f-fdcb-4da4-8c77-9a2e2c58a8d6 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:27.957484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e696150f-fdcb-4da4-8c77-9a2e2c58a8d6 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:27.957971 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e696150f-fdcb-4da4-8c77-9a2e2c58a8d6 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:27.958734 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e696150f-fdcb-4da4-8c77-9a2e2c58a8d6 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:27.959165 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e696150f-fdcb-4da4-8c77-9a2e2c58a8d6 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:28.094725 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e696150f-fdcb-4da4-8c77-9a2e2c58a8d6 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:28.102470 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e696150f-fdcb-4da4-8c77-9a2e2c58a8d6 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb" status: 200 len: 1504 microversion: 2.1 time: 0.156327 Jul 04 04:26:28.103028 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 518/1019] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:27 2022] GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:28.949052 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-34a0956b-6132-4a18-9667-f345d9cdb470 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:28.950301 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-34a0956b-6132-4a18-9667-f345d9cdb470 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:28.956871 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-34a0956b-6132-4a18-9667-f345d9cdb470 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:28.957320 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-34a0956b-6132-4a18-9667-f345d9cdb470 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:28.958089 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-34a0956b-6132-4a18-9667-f345d9cdb470 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:28.958549 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-34a0956b-6132-4a18-9667-f345d9cdb470 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:28.987680 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-34a0956b-6132-4a18-9667-f345d9cdb470 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042974 Jul 04 04:26:28.988228 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 502/1020] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:26:28 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 04:26:29.045152 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b72a1d9f-7250-4921-aecc-971652cd9175 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:29.045735 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b72a1d9f-7250-4921-aecc-971652cd9175 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:29.052373 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b72a1d9f-7250-4921-aecc-971652cd9175 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:29.052831 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b72a1d9f-7250-4921-aecc-971652cd9175 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:29.053600 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b72a1d9f-7250-4921-aecc-971652cd9175 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:29.054035 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b72a1d9f-7250-4921-aecc-971652cd9175 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:29.079557 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b72a1d9f-7250-4921-aecc-971652cd9175 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Going to try to terminate instance {{(pid=117875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:26:29.120918 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d5d49b01-3a1c-46b3-9cc6-da9816bd58ae tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:29.122150 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d5d49b01-3a1c-46b3-9cc6-da9816bd58ae tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:29.129571 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5d49b01-3a1c-46b3-9cc6-da9816bd58ae tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:29.130702 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5d49b01-3a1c-46b3-9cc6-da9816bd58ae tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:29.131657 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5d49b01-3a1c-46b3-9cc6-da9816bd58ae tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:29.132545 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5d49b01-3a1c-46b3-9cc6-da9816bd58ae tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:29.165755 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b72a1d9f-7250-4921-aecc-971652cd9175 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 204 len: 0 microversion: 2.1 time: 0.124393 Jul 04 04:26:29.166363 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 519/1021] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:26:29 2022] DELETE /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:26:29.175503 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-cbf5fe8d-a94b-45ee-9a74-45b3ff1f5a85 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:29.176203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-cbf5fe8d-a94b-45ee-9a74-45b3ff1f5a85 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:29.182251 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cbf5fe8d-a94b-45ee-9a74-45b3ff1f5a85 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:29.182728 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cbf5fe8d-a94b-45ee-9a74-45b3ff1f5a85 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:29.183683 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cbf5fe8d-a94b-45ee-9a74-45b3ff1f5a85 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:29.184117 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cbf5fe8d-a94b-45ee-9a74-45b3ff1f5a85 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:29.275964 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d5d49b01-3a1c-46b3-9cc6-da9816bd58ae tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:29.283827 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d5d49b01-3a1c-46b3-9cc6-da9816bd58ae tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb" status: 200 len: 1504 microversion: 2.1 time: 0.167761 Jul 04 04:26:29.284412 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 503/1022] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:29 2022] GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:29.322519 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-cbf5fe8d-a94b-45ee-9a74-45b3ff1f5a85 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:29.333620 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-cbf5fe8d-a94b-45ee-9a74-45b3ff1f5a85 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1673 microversion: 2.1 time: 0.162627 Jul 04 04:26:29.334169 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 520/1023] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:29 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:30.300997 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bb1f4ec9-a1cd-4772-b92e-a28114eaf737 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:30.301729 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bb1f4ec9-a1cd-4772-b92e-a28114eaf737 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:30.308587 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb1f4ec9-a1cd-4772-b92e-a28114eaf737 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:30.309042 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb1f4ec9-a1cd-4772-b92e-a28114eaf737 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:30.309890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb1f4ec9-a1cd-4772-b92e-a28114eaf737 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:30.310279 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb1f4ec9-a1cd-4772-b92e-a28114eaf737 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:30.351216 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-11a2152f-435d-4e79-ba9f-049b0e95603f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:30.351960 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-11a2152f-435d-4e79-ba9f-049b0e95603f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:30.358799 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-11a2152f-435d-4e79-ba9f-049b0e95603f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:30.359286 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-11a2152f-435d-4e79-ba9f-049b0e95603f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:30.360057 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-11a2152f-435d-4e79-ba9f-049b0e95603f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:30.360599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-11a2152f-435d-4e79-ba9f-049b0e95603f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:30.460912 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bb1f4ec9-a1cd-4772-b92e-a28114eaf737 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:30.468609 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bb1f4ec9-a1cd-4772-b92e-a28114eaf737 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb" status: 200 len: 1504 microversion: 2.1 time: 0.172458 Jul 04 04:26:30.469649 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 504/1024] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:30 2022] GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:30.504573 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-11a2152f-435d-4e79-ba9f-049b0e95603f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:30.512822 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-11a2152f-435d-4e79-ba9f-049b0e95603f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1673 microversion: 2.1 time: 0.165628 Jul 04 04:26:30.513401 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 521/1025] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:30 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:31.486553 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9c257cfb-473d-4c0d-ac85-0a82e291fb75 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:31.488179 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9c257cfb-473d-4c0d-ac85-0a82e291fb75 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:31.496523 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c257cfb-473d-4c0d-ac85-0a82e291fb75 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:31.497277 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c257cfb-473d-4c0d-ac85-0a82e291fb75 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:31.498312 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c257cfb-473d-4c0d-ac85-0a82e291fb75 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:31.498930 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c257cfb-473d-4c0d-ac85-0a82e291fb75 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:31.531666 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-fa2ecb87-73df-40b7-a962-1bea40f8b2d4 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:31.532403 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-fa2ecb87-73df-40b7-a962-1bea40f8b2d4 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:31.542939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fa2ecb87-73df-40b7-a962-1bea40f8b2d4 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:31.546064 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fa2ecb87-73df-40b7-a962-1bea40f8b2d4 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:31.547270 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fa2ecb87-73df-40b7-a962-1bea40f8b2d4 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:31.549993 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fa2ecb87-73df-40b7-a962-1bea40f8b2d4 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:31.823734 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-fa2ecb87-73df-40b7-a962-1bea40f8b2d4 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:31.839152 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-fa2ecb87-73df-40b7-a962-1bea40f8b2d4 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1673 microversion: 2.1 time: 0.311623 Jul 04 04:26:31.840401 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 522/1026] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:31 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1673 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:31.875091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9c257cfb-473d-4c0d-ac85-0a82e291fb75 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:31.885902 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9c257cfb-473d-4c0d-ac85-0a82e291fb75 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb" status: 200 len: 1504 microversion: 2.1 time: 0.403709 Jul 04 04:26:31.887473 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 505/1027] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:31 2022] GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb => generated 1504 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:26:32.177386 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-d8ea7036-d7ad-4f93-8da8-04edcc6d56d8 req-f3655d02-f865-42fb-9589-9eb2dcdd45eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb", "name": "network-vif-deleted", "tag": "36d5a35c-ec51-4bd4-860c-705100cca559"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:26:32.188610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-d8ea7036-d7ad-4f93-8da8-04edcc6d56d8 req-f3655d02-f865-42fb-9589-9eb2dcdd45eb service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:32.189176 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-d8ea7036-d7ad-4f93-8da8-04edcc6d56d8 req-f3655d02-f865-42fb-9589-9eb2dcdd45eb service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:32.202810 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-d8ea7036-d7ad-4f93-8da8-04edcc6d56d8 req-f3655d02-f865-42fb-9589-9eb2dcdd45eb service nova] Creating event network-vif-deleted:36d5a35c-ec51-4bd4-860c-705100cca559 for instance d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb on hv-cinder-74216 Jul 04 04:26:32.208309 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-d8ea7036-d7ad-4f93-8da8-04edcc6d56d8 req-f3655d02-f865-42fb-9589-9eb2dcdd45eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040848 Jul 04 04:26:32.209487 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 523/1028] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:26:32.655940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-c4698f40-77ea-47d8-bf5e-a9ff7a09d887 req-e5064e03-55c2-49a8-b45e-1110f364534b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5a126f-e314-44bc-8697-7b07760da296", "name": "network-vif-deleted", "tag": "85defb10-99ae-43aa-8776-2102f58dfbac"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:26:32.667911 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c4698f40-77ea-47d8-bf5e-a9ff7a09d887 req-e5064e03-55c2-49a8-b45e-1110f364534b service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:32.668357 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c4698f40-77ea-47d8-bf5e-a9ff7a09d887 req-e5064e03-55c2-49a8-b45e-1110f364534b service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:32.691907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-c4698f40-77ea-47d8-bf5e-a9ff7a09d887 req-e5064e03-55c2-49a8-b45e-1110f364534b service nova] Creating event network-vif-deleted:85defb10-99ae-43aa-8776-2102f58dfbac for instance fb5a126f-e314-44bc-8697-7b07760da296 on hv-cinder-74216 Jul 04 04:26:32.701051 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-c4698f40-77ea-47d8-bf5e-a9ff7a09d887 req-e5064e03-55c2-49a8-b45e-1110f364534b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199492 Jul 04 04:26:32.701914 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 506/1029] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:26:32.858407 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5ab1c558-fc5c-4371-8881-61e8bdba106c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:32.859323 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5ab1c558-fc5c-4371-8881-61e8bdba106c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:32.868367 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5ab1c558-fc5c-4371-8881-61e8bdba106c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:32.868841 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5ab1c558-fc5c-4371-8881-61e8bdba106c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:32.869612 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5ab1c558-fc5c-4371-8881-61e8bdba106c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:32.870045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5ab1c558-fc5c-4371-8881-61e8bdba106c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:32.905038 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5ab1c558-fc5c-4371-8881-61e8bdba106c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:32.905524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5ab1c558-fc5c-4371-8881-61e8bdba106c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:32.906023 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.objects.instance [None req-5ab1c558-fc5c-4371-8881-61e8bdba106c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lazy-loading 'fault' on Instance uuid fb5a126f-e314-44bc-8697-7b07760da296 {{(pid=117875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:26:32.906500 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c10c6f41-08cd-4e31-adac-222a04fbed19 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:32.907374 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c10c6f41-08cd-4e31-adac-222a04fbed19 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:32.915559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c10c6f41-08cd-4e31-adac-222a04fbed19 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:32.916185 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c10c6f41-08cd-4e31-adac-222a04fbed19 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:32.917047 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c10c6f41-08cd-4e31-adac-222a04fbed19 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:32.917706 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c10c6f41-08cd-4e31-adac-222a04fbed19 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:32.932770 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-c10c6f41-08cd-4e31-adac-222a04fbed19 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] HTTP exception thrown: Instance d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb could not be found. Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c10c6f41-08cd-4e31-adac-222a04fbed19 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Request method failure captured: Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb HTTP/1.1 Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmvk0MFRhT05Wvq6NYOuVIc96ODLSqTJmtglHhaSruDEpM6zvAhHvonnNYzfr45_Y-y6hAGBtM8vL4qTS69vXYiekP9oBXh89WF5Y5M1_KH-K-qoMX4d8ng3okfD-DPtOgpg7F4oC0XchvgP2Myq2zIp0EkDuVBSw9haMd6xJXsg4m0 Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: d770140713d34c5ab7c8775e5e9837fa Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-VolumesActionsTest-1902097920 Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:26:32.934590 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:26:32.936271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d770140713d34c5ab7c8775e5e9837fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d770140713d34c5ab7c8775e5e9837fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d770140713d34c5ab7c8775e5e9837fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d770140713d34c5ab7c8775e5e9837fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:26:32.936271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-VolumesActionsTest-1902097920 Jul 04 04:26:32.936271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: d770140713d34c5ab7c8775e5e9837fa Jul 04 04:26:32.936271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-VolumesActionsTest-1902097920 Jul 04 04:26:32.936271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-VolumesActionsTest-1902097920-project Jul 04 04:26:32.936271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:26:32.936271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:26:32.936271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: 3f505d44f601474aafa4ee57e71588a7 Jul 04 04:26:32.936271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-VolumesActionsTest-1902097920-project Jul 04 04:26:32.936271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:26:32.936271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb could not be found. Jul 04 04:26:32.936271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': 'd0fa4639-899c-4ebb-b2ae-4ced3e3c30eb'} Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb could not be found. Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:26:32.937234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:26:32.938778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:26:32.938778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:26:32.938778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:26:32.938778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:26:32.938778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:26:32.938778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:26:32.938778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:26:32.938778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb could not be found. Jul 04 04:26:32.938778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:26:32.938778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:26:32.938778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:26:32.938778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:26:32.938778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:26:32.938778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:26:32.938778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:26:32.938778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:26:32.938778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb could not be found. Jul 04 04:26:32.938778 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:26:32.940252 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c10c6f41-08cd-4e31-adac-222a04fbed19 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Returning 404 to user: Instance d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:26:32.940252 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c10c6f41-08cd-4e31-adac-222a04fbed19 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb" status: 404 len: 111 microversion: 2.1 time: 0.037186 Jul 04 04:26:32.949411 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 507/1030] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:32 2022] GET /compute/v2.1/servers/d0fa4639-899c-4ebb-b2ae-4ced3e3c30eb => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 04:26:32.970283 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5ab1c558-fc5c-4371-8881-61e8bdba106c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:32.978462 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5ab1c558-fc5c-4371-8881-61e8bdba106c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 200 len: 1326 microversion: 2.1 time: 0.124652 Jul 04 04:26:32.979687 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 524/1031] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:32 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 1326 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:33.041125 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2a90ab2c-c95e-42e7-b6bb-be42e5e00aeb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-186511099", "imageRef": "46b9937d-f997-401a-a3aa-bb9028764454", "flavorRef": "452", "networks": [{"uuid": "72171f11-8631-4b27-9aa8-5cd98daeeeb4"}]}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:26:33.095017 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-2a90ab2c-c95e-42e7-b6bb-be42e5e00aeb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] validate_networks() for [('72171f11-8631-4b27-9aa8-5cd98daeeeb4', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:26:33.513462 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-2a90ab2c-c95e-42e7-b6bb-be42e5e00aeb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:26:33.514468 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-2a90ab2c-c95e-42e7-b6bb-be42e5e00aeb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:26:33.515034 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-2a90ab2c-c95e-42e7-b6bb-be42e5e00aeb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:26:33.515510 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-2a90ab2c-c95e-42e7-b6bb-be42e5e00aeb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:26:33.515989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-2a90ab2c-c95e-42e7-b6bb-be42e5e00aeb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:26:33.525645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a90ab2c-c95e-42e7-b6bb-be42e5e00aeb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:33.526162 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a90ab2c-c95e-42e7-b6bb-be42e5e00aeb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:33.527122 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a90ab2c-c95e-42e7-b6bb-be42e5e00aeb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:33.527807 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a90ab2c-c95e-42e7-b6bb-be42e5e00aeb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:33.547810 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-2a90ab2c-c95e-42e7-b6bb-be42e5e00aeb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Getting quotas for project d770140713d34c5ab7c8775e5e9837fa. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:26:33.553012 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-2a90ab2c-c95e-42e7-b6bb-be42e5e00aeb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Getting quotas for user 3f505d44f601474aafa4ee57e71588a7 and project d770140713d34c5ab7c8775e5e9837fa. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:26:33.564469 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2a90ab2c-c95e-42e7-b6bb-be42e5e00aeb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:26:33.567110 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2a90ab2c-c95e-42e7-b6bb-be42e5e00aeb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46b9937d-f997-401a-a3aa-bb9028764454',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:26:33.616722 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2a90ab2c-c95e-42e7-b6bb-be42e5e00aeb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579513 Jul 04 04:26:33.618202 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 508/1032] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:26:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 04:26:33.628034 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7aee9558-7c62-4d11-863d-0f268ac83fc0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:33.628699 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7aee9558-7c62-4d11-863d-0f268ac83fc0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:33.695108 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7aee9558-7c62-4d11-863d-0f268ac83fc0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:33.702633 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7aee9558-7c62-4d11-863d-0f268ac83fc0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 200 len: 1213 microversion: 2.1 time: 0.078622 Jul 04 04:26:33.703308 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 525/1033] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:33 2022] GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:33.997856 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-581d3358-e499-4757-9209-e4bdb50c8196 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:33.998468 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-581d3358-e499-4757-9209-e4bdb50c8196 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:34.005140 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-581d3358-e499-4757-9209-e4bdb50c8196 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:34.005626 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-581d3358-e499-4757-9209-e4bdb50c8196 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:34.006514 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-581d3358-e499-4757-9209-e4bdb50c8196 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:34.006985 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-581d3358-e499-4757-9209-e4bdb50c8196 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:34.021864 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-581d3358-e499-4757-9209-e4bdb50c8196 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] HTTP exception thrown: Instance fb5a126f-e314-44bc-8697-7b07760da296 could not be found. Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-581d3358-e499-4757-9209-e4bdb50c8196 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Request method failure captured: Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 HTTP/1.1 Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmrfaO3tTuR89AMFKfPX0RdTd_VKxHyXE_3Q3jQmPssjDPyF3KwI1Yk73lT9bZ8JO3DYK0VwahirWvx4zORYpmB2Q897B1s5tSXtsUuULSWkNKhZ2FkTOChTg7TEkduf-y8AGc2z617FeDLT_dJwQxhoe5ZJ4ZqE126qAXFYT4sqMW4 Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 0bd3f8996b5b46f6904e32023b092e5d Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeTestJSON-1160839055 Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:26:34.023424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:26:34.025078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0bd3f8996b5b46f6904e32023b092e5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0bd3f8996b5b46f6904e32023b092e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0bd3f8996b5b46f6904e32023b092e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0bd3f8996b5b46f6904e32023b092e5d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:26:34.025078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeTestJSON-1160839055 Jul 04 04:26:34.025078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 0bd3f8996b5b46f6904e32023b092e5d Jul 04 04:26:34.025078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1160839055 Jul 04 04:26:34.025078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeTestJSON-1160839055-project Jul 04 04:26:34.025078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:26:34.025078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:26:34.025078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: ccf66c5198f24f7cbc39132635c03611 Jul 04 04:26:34.025078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeTestJSON-1160839055-project Jul 04 04:26:34.025078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:26:34.025078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance fb5a126f-e314-44bc-8697-7b07760da296 could not be found. Jul 04 04:26:34.025078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': 'fb5a126f-e314-44bc-8697-7b07760da296'} Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5a126f-e314-44bc-8697-7b07760da296 could not be found. Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:26:34.029282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:26:34.030788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:26:34.030788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:26:34.030788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:26:34.030788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:26:34.030788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:26:34.030788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:26:34.030788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:26:34.030788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5a126f-e314-44bc-8697-7b07760da296 could not be found. Jul 04 04:26:34.030788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:26:34.030788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:26:34.030788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:26:34.030788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:26:34.030788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:26:34.030788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:26:34.030788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:26:34.030788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:26:34.030788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5a126f-e314-44bc-8697-7b07760da296 could not be found. Jul 04 04:26:34.030788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:26:34.032272 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-581d3358-e499-4757-9209-e4bdb50c8196 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Returning 404 to user: Instance fb5a126f-e314-44bc-8697-7b07760da296 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:26:34.032272 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-581d3358-e499-4757-9209-e4bdb50c8196 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 404 len: 111 microversion: 2.1 time: 0.031304 Jul 04 04:26:34.032272 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 509/1034] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:33 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:26:34.037810 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-030d305a-c618-4a0a-86ff-f2ae5d4995b1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '.version_select at 0x7f50c11a0280>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:34.056970 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-030d305a-c618-4a0a-86ff-f2ae5d4995b1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-503811916" status: 202 len: 0 microversion: 2.1 time: 0.023169 Jul 04 04:26:34.057548 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 526/1035] 10.222.0.16 () {58 vars in 1217 bytes} [Mon Jul 4 04:26:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-503811916 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:26:34.721507 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-336073e1-61ae-496d-98d6-05779550c7af tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:34.723862 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-336073e1-61ae-496d-98d6-05779550c7af tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:34.732152 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-336073e1-61ae-496d-98d6-05779550c7af tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:34.733007 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-336073e1-61ae-496d-98d6-05779550c7af tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:34.734168 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-336073e1-61ae-496d-98d6-05779550c7af tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:34.734823 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-336073e1-61ae-496d-98d6-05779550c7af tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:34.773626 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a30aa0e3-48c7-4ef8-812e-44e931eabc03 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Action: 'create', calling method: .version_select at 0x7f50c10f88b0>, body: {"keypair": {"name": "tempest-keypair-660883046", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFB5jkyjJqqxplklnARKnj0EgxRROlSKb9H4xsHfVmlcBPlPU2cBL3SkzAyIafoIP4G/ruStaatGBXP6uhQw4ifmSJBf63IHgGH+ouN4CiPiXgmsiqAiV8WEBBNZDtbVJw=="}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:26:34.799556 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-a30aa0e3-48c7-4ef8-812e-44e931eabc03 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Getting quotas for project 0bd3f8996b5b46f6904e32023b092e5d. Resources: {'key_pairs'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:26:34.806585 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-a30aa0e3-48c7-4ef8-812e-44e931eabc03 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Getting quotas for user ccf66c5198f24f7cbc39132635c03611 and project 0bd3f8996b5b46f6904e32023b092e5d. Resources: {'key_pairs'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:26:34.836368 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a30aa0e3-48c7-4ef8-812e-44e931eabc03 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.066676 Jul 04 04:26:34.842854 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 527/1036] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jul 4 04:26:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:26:34.858781 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-336073e1-61ae-496d-98d6-05779550c7af tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:34.873009 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-336073e1-61ae-496d-98d6-05779550c7af tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 200 len: 1283 microversion: 2.1 time: 0.156538 Jul 04 04:26:34.874487 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 510/1037] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:34 2022] GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 1283 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:35.894633 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1948ee78-998f-4a07-84ac-0468cba7fc2b tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:35.895269 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-1948ee78-998f-4a07-84ac-0468cba7fc2b tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:35.902729 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1948ee78-998f-4a07-84ac-0468cba7fc2b tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:35.903194 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1948ee78-998f-4a07-84ac-0468cba7fc2b tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:35.903989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1948ee78-998f-4a07-84ac-0468cba7fc2b tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:35.904424 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1948ee78-998f-4a07-84ac-0468cba7fc2b tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:36.223748 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-1948ee78-998f-4a07-84ac-0468cba7fc2b tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:36.237851 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-1948ee78-998f-4a07-84ac-0468cba7fc2b tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 200 len: 1313 microversion: 2.1 time: 0.348313 Jul 04 04:26:36.243196 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 528/1038] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:35 2022] GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:36.894103 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-19a5d443-6dfc-4e1c-98a5-4f2fa66b108c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-422126454", "imageRef": "46b9937d-f997-401a-a3aa-bb9028764454", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d24f9b7-eac9-447b-b6d4-fce3782f951d"}], "security_groups": [{"name": "tempest-securitygroup--1837062807"}], "key_name": "tempest-keypair-660883046", "user_data": "}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:26:37.008384 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-19a5d443-6dfc-4e1c-98a5-4f2fa66b108c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] validate_networks() for [('1d24f9b7-eac9-447b-b6d4-fce3782f951d', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:26:37.047327 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-834e43b4-4678-4076-8791-bf5943424acf req-6c9a0310-7adc-446e-90e7-f52f4a41f930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "676f9a50-d2ef-45c2-b4e9-5405721e1bfd", "tag": "eb69aec2-cc38-478b-9e7b-3ba07920e411"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:26:37.056217 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-834e43b4-4678-4076-8791-bf5943424acf req-6c9a0310-7adc-446e-90e7-f52f4a41f930 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:37.057043 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-834e43b4-4678-4076-8791-bf5943424acf req-6c9a0310-7adc-446e-90e7-f52f4a41f930 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:37.070980 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-834e43b4-4678-4076-8791-bf5943424acf req-6c9a0310-7adc-446e-90e7-f52f4a41f930 service nova] Creating event network-changed:eb69aec2-cc38-478b-9e7b-3ba07920e411 for instance 676f9a50-d2ef-45c2-b4e9-5405721e1bfd on hv-cinder-74216 Jul 04 04:26:37.077762 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-834e43b4-4678-4076-8791-bf5943424acf req-6c9a0310-7adc-446e-90e7-f52f4a41f930 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033930 Jul 04 04:26:37.078836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 529/1039] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:26:37.256151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-8620fcce-afd3-468f-9edc-09c5bf2a05c0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:37.257486 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-8620fcce-afd3-468f-9edc-09c5bf2a05c0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:37.265165 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8620fcce-afd3-468f-9edc-09c5bf2a05c0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:37.265747 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8620fcce-afd3-468f-9edc-09c5bf2a05c0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:37.266644 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8620fcce-afd3-468f-9edc-09c5bf2a05c0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:37.267162 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8620fcce-afd3-468f-9edc-09c5bf2a05c0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:37.455130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-19a5d443-6dfc-4e1c-98a5-4f2fa66b108c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:26:37.455130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-19a5d443-6dfc-4e1c-98a5-4f2fa66b108c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:26:37.455130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-19a5d443-6dfc-4e1c-98a5-4f2fa66b108c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:26:37.455130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-19a5d443-6dfc-4e1c-98a5-4f2fa66b108c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:26:37.455130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-19a5d443-6dfc-4e1c-98a5-4f2fa66b108c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:26:37.465476 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19a5d443-6dfc-4e1c-98a5-4f2fa66b108c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:37.466238 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19a5d443-6dfc-4e1c-98a5-4f2fa66b108c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:37.468219 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19a5d443-6dfc-4e1c-98a5-4f2fa66b108c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:37.468666 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-19a5d443-6dfc-4e1c-98a5-4f2fa66b108c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:37.485377 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-8620fcce-afd3-468f-9edc-09c5bf2a05c0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:37.488869 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-19a5d443-6dfc-4e1c-98a5-4f2fa66b108c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Getting quotas for project 0bd3f8996b5b46f6904e32023b092e5d. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:26:37.490262 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:26:37.494149 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-19a5d443-6dfc-4e1c-98a5-4f2fa66b108c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Getting quotas for user ccf66c5198f24f7cbc39132635c03611 and project 0bd3f8996b5b46f6904e32023b092e5d. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:26:37.498442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-8620fcce-afd3-468f-9edc-09c5bf2a05c0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 200 len: 1313 microversion: 2.1 time: 0.246470 Jul 04 04:26:37.499601 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 530/1040] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:37 2022] GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:26:37.506758 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-19a5d443-6dfc-4e1c-98a5-4f2fa66b108c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:26:37.509781 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-19a5d443-6dfc-4e1c-98a5-4f2fa66b108c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46b9937d-f997-401a-a3aa-bb9028764454',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:26:37.561541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-19a5d443-6dfc-4e1c-98a5-4f2fa66b108c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.671962 Jul 04 04:26:37.563032 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 511/1041] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:26:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 04:26:37.574130 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-30fe7406-930f-4b01-a478-1d20d17b76e3 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:37.574775 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-30fe7406-930f-4b01-a478-1d20d17b76e3 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:37.685348 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-30fe7406-930f-4b01-a478-1d20d17b76e3 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:37.693086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-30fe7406-930f-4b01-a478-1d20d17b76e3 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1236 microversion: 2.1 time: 0.123222 Jul 04 04:26:37.693731 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 531/1042] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:37 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1236 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:38.518187 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-205a3946-7f2e-4cff-8c7a-5c2f76571b85 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:38.518838 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-205a3946-7f2e-4cff-8c7a-5c2f76571b85 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:38.526789 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-205a3946-7f2e-4cff-8c7a-5c2f76571b85 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:38.527370 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-205a3946-7f2e-4cff-8c7a-5c2f76571b85 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:38.528443 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-205a3946-7f2e-4cff-8c7a-5c2f76571b85 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:38.528878 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-205a3946-7f2e-4cff-8c7a-5c2f76571b85 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:38.670239 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-205a3946-7f2e-4cff-8c7a-5c2f76571b85 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:38.677913 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-205a3946-7f2e-4cff-8c7a-5c2f76571b85 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 200 len: 1313 microversion: 2.1 time: 0.165840 Jul 04 04:26:38.678506 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 512/1043] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:38 2022] GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:38.710562 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-78ca8e58-bdad-4928-abb6-86a5daf6046d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:38.711143 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-78ca8e58-bdad-4928-abb6-86a5daf6046d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:38.717832 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-78ca8e58-bdad-4928-abb6-86a5daf6046d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:38.718280 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-78ca8e58-bdad-4928-abb6-86a5daf6046d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:38.719070 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-78ca8e58-bdad-4928-abb6-86a5daf6046d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:38.719523 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-78ca8e58-bdad-4928-abb6-86a5daf6046d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:38.785958 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-78ca8e58-bdad-4928-abb6-86a5daf6046d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:38.793624 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-78ca8e58-bdad-4928-abb6-86a5daf6046d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1240 microversion: 2.1 time: 0.087151 Jul 04 04:26:38.794193 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 532/1044] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:38 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:39.695184 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6664eccc-02ad-46e9-956c-8c31430004a8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:39.695796 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6664eccc-02ad-46e9-956c-8c31430004a8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:39.702592 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6664eccc-02ad-46e9-956c-8c31430004a8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:39.703040 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6664eccc-02ad-46e9-956c-8c31430004a8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:39.703805 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6664eccc-02ad-46e9-956c-8c31430004a8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:39.704236 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6664eccc-02ad-46e9-956c-8c31430004a8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:39.811476 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-129f99d8-5a98-4b13-86e3-a31f77c61556 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:39.812151 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-129f99d8-5a98-4b13-86e3-a31f77c61556 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:39.820847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-129f99d8-5a98-4b13-86e3-a31f77c61556 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:39.821274 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-129f99d8-5a98-4b13-86e3-a31f77c61556 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:39.822240 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-129f99d8-5a98-4b13-86e3-a31f77c61556 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:39.822866 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-129f99d8-5a98-4b13-86e3-a31f77c61556 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:39.866456 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6664eccc-02ad-46e9-956c-8c31430004a8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:39.874637 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6664eccc-02ad-46e9-956c-8c31430004a8 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 200 len: 1313 microversion: 2.1 time: 0.183386 Jul 04 04:26:39.875451 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 513/1045] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:39 2022] GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:39.925966 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-129f99d8-5a98-4b13-86e3-a31f77c61556 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:39.934871 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-129f99d8-5a98-4b13-86e3-a31f77c61556 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1240 microversion: 2.1 time: 0.127992 Jul 04 04:26:39.935438 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 533/1046] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:39 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1240 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:26:40.893451 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-310d38eb-79dd-440f-9449-34a50b41b47c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:40.894540 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-310d38eb-79dd-440f-9449-34a50b41b47c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:40.903101 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-310d38eb-79dd-440f-9449-34a50b41b47c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:40.903641 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-310d38eb-79dd-440f-9449-34a50b41b47c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:40.904697 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-310d38eb-79dd-440f-9449-34a50b41b47c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:40.905127 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-310d38eb-79dd-440f-9449-34a50b41b47c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:40.910701 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:26:40.951836 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-925af328-fe41-45ee-895f-c54d9be51914 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:40.952445 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-925af328-fe41-45ee-895f-c54d9be51914 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:40.959127 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-925af328-fe41-45ee-895f-c54d9be51914 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:40.959588 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-925af328-fe41-45ee-895f-c54d9be51914 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:40.960446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-925af328-fe41-45ee-895f-c54d9be51914 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:40.960920 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-925af328-fe41-45ee-895f-c54d9be51914 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:41.026747 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-925af328-fe41-45ee-895f-c54d9be51914 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:41.034303 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-925af328-fe41-45ee-895f-c54d9be51914 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1294 microversion: 2.1 time: 0.086442 Jul 04 04:26:41.034978 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 534/1047] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:40 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:26:41.248174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-310d38eb-79dd-440f-9449-34a50b41b47c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:41.256104 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-310d38eb-79dd-440f-9449-34a50b41b47c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 200 len: 1313 microversion: 2.1 time: 0.367545 Jul 04 04:26:41.256772 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 514/1048] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:40 2022] GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:42.056556 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f70fd4f0-caba-475a-bd87-a4cba7d3cc88 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:42.057715 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f70fd4f0-caba-475a-bd87-a4cba7d3cc88 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:42.067232 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f70fd4f0-caba-475a-bd87-a4cba7d3cc88 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:42.067688 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f70fd4f0-caba-475a-bd87-a4cba7d3cc88 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:42.069111 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f70fd4f0-caba-475a-bd87-a4cba7d3cc88 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:42.069553 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f70fd4f0-caba-475a-bd87-a4cba7d3cc88 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:42.085338 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c9e00825-e383-43f4-843d-86daf3cf71b3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:42.086683 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c9e00825-e383-43f4-843d-86daf3cf71b3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:42.102643 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9e00825-e383-43f4-843d-86daf3cf71b3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:42.108036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9e00825-e383-43f4-843d-86daf3cf71b3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:42.109156 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9e00825-e383-43f4-843d-86daf3cf71b3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:42.109808 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9e00825-e383-43f4-843d-86daf3cf71b3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:42.169331 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c9e00825-e383-43f4-843d-86daf3cf71b3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:26:42.220214 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f70fd4f0-caba-475a-bd87-a4cba7d3cc88 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:42.228771 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-f70fd4f0-caba-475a-bd87-a4cba7d3cc88 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1362 microversion: 2.1 time: 0.180521 Jul 04 04:26:42.230101 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 535/1049] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:42 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:42.234787 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-64039ebe-1f40-4167-8348-18fc90237ce5 req-fd2f979a-4279-4432-bbdc-196387e51a1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc477aae-9332-481d-bb4f-d1d8ff671c43", "tag": "9a95c8cb-e9e6-4776-92fc-f9a7a4174643"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:26:42.244460 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-64039ebe-1f40-4167-8348-18fc90237ce5 req-fd2f979a-4279-4432-bbdc-196387e51a1c service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:42.245319 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-64039ebe-1f40-4167-8348-18fc90237ce5 req-fd2f979a-4279-4432-bbdc-196387e51a1c service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:42.259196 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-64039ebe-1f40-4167-8348-18fc90237ce5 req-fd2f979a-4279-4432-bbdc-196387e51a1c service nova] Creating event network-changed:9a95c8cb-e9e6-4776-92fc-f9a7a4174643 for instance dc477aae-9332-481d-bb4f-d1d8ff671c43 on hv-cinder-74216 Jul 04 04:26:42.264956 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-64039ebe-1f40-4167-8348-18fc90237ce5 req-fd2f979a-4279-4432-bbdc-196387e51a1c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033419 Jul 04 04:26:42.265775 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 536/1050] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:26:42.282636 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5b11aa17-5047-41e0-8c03-eb729ba097a0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:42.286148 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5b11aa17-5047-41e0-8c03-eb729ba097a0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:42.301442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5b11aa17-5047-41e0-8c03-eb729ba097a0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:42.301891 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5b11aa17-5047-41e0-8c03-eb729ba097a0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:42.302733 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5b11aa17-5047-41e0-8c03-eb729ba097a0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:42.303171 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5b11aa17-5047-41e0-8c03-eb729ba097a0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:42.317567 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:26:42.333939 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c9e00825-e383-43f4-843d-86daf3cf71b3 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 204 len: 0 microversion: 2.1 time: 0.254891 Jul 04 04:26:42.334657 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 515/1051] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:26:42 2022] DELETE /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 04 04:26:42.344336 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-782f9c0c-72fe-4aaf-8555-e53dc92ecd7a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:42.345133 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-782f9c0c-72fe-4aaf-8555-e53dc92ecd7a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:42.362201 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-782f9c0c-72fe-4aaf-8555-e53dc92ecd7a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:42.364079 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-782f9c0c-72fe-4aaf-8555-e53dc92ecd7a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:42.366054 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-782f9c0c-72fe-4aaf-8555-e53dc92ecd7a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:42.366994 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-782f9c0c-72fe-4aaf-8555-e53dc92ecd7a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:42.535492 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-5b11aa17-5047-41e0-8c03-eb729ba097a0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:42.544816 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5b11aa17-5047-41e0-8c03-eb729ba097a0 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 200 len: 1313 microversion: 2.1 time: 0.275329 Jul 04 04:26:42.555573 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 537/1052] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:42 2022] GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:42.897357 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-782f9c0c-72fe-4aaf-8555-e53dc92ecd7a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:42.905968 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-782f9c0c-72fe-4aaf-8555-e53dc92ecd7a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1578 microversion: 2.1 time: 0.566694 Jul 04 04:26:42.906704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 516/1053] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:42 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1578 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:26:43.246888 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ebda1b6f-7a29-4a07-bc61-a9ed8f73bd7d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:43.248215 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-ebda1b6f-7a29-4a07-bc61-a9ed8f73bd7d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:43.262499 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ebda1b6f-7a29-4a07-bc61-a9ed8f73bd7d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:43.263124 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ebda1b6f-7a29-4a07-bc61-a9ed8f73bd7d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:43.265160 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ebda1b6f-7a29-4a07-bc61-a9ed8f73bd7d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:43.267485 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ebda1b6f-7a29-4a07-bc61-a9ed8f73bd7d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:43.557106 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-ebda1b6f-7a29-4a07-bc61-a9ed8f73bd7d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:43.563947 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-35104134-635a-4b0f-a90d-a922a2ebc6cb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:43.564892 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-35104134-635a-4b0f-a90d-a922a2ebc6cb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:43.570482 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ebda1b6f-7a29-4a07-bc61-a9ed8f73bd7d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1362 microversion: 2.1 time: 0.326746 Jul 04 04:26:43.572470 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 538/1054] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:43 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:43.582895 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35104134-635a-4b0f-a90d-a922a2ebc6cb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:43.591276 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35104134-635a-4b0f-a90d-a922a2ebc6cb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:43.592533 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35104134-635a-4b0f-a90d-a922a2ebc6cb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:43.593142 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35104134-635a-4b0f-a90d-a922a2ebc6cb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:43.837429 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-35104134-635a-4b0f-a90d-a922a2ebc6cb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:43.845271 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-35104134-635a-4b0f-a90d-a922a2ebc6cb tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 200 len: 1313 microversion: 2.1 time: 0.286515 Jul 04 04:26:43.846039 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 517/1055] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:43 2022] GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:43.924947 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-bc9b7366-4518-4c4f-a987-97804e013b93 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:43.926287 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-bc9b7366-4518-4c4f-a987-97804e013b93 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:43.932522 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bc9b7366-4518-4c4f-a987-97804e013b93 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:43.932973 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bc9b7366-4518-4c4f-a987-97804e013b93 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:43.933747 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bc9b7366-4518-4c4f-a987-97804e013b93 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:43.934185 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bc9b7366-4518-4c4f-a987-97804e013b93 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:44.153341 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-bc9b7366-4518-4c4f-a987-97804e013b93 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:44.165627 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-bc9b7366-4518-4c4f-a987-97804e013b93 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1578 microversion: 2.1 time: 0.244020 Jul 04 04:26:44.167140 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 539/1056] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:43 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1578 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:44.589204 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7e14a167-35c4-40de-bcad-eaac5cbf0beb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:44.590175 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7e14a167-35c4-40de-bcad-eaac5cbf0beb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:44.607624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e14a167-35c4-40de-bcad-eaac5cbf0beb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:44.608130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e14a167-35c4-40de-bcad-eaac5cbf0beb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:44.609837 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e14a167-35c4-40de-bcad-eaac5cbf0beb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:44.611633 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7e14a167-35c4-40de-bcad-eaac5cbf0beb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:44.668761 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-4b121b0b-2d92-4bce-bd51-edeceb2235fe req-cd5c4053-6858-496c-bf30-b0a7f0d0efe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33838c72-5e62-4317-ab27-5e45d243c3ec", "tag": "70b5cda6-ca03-4f8e-a787-c270f412d879"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:26:44.679538 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-4b121b0b-2d92-4bce-bd51-edeceb2235fe req-cd5c4053-6858-496c-bf30-b0a7f0d0efe9 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:44.680825 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-4b121b0b-2d92-4bce-bd51-edeceb2235fe req-cd5c4053-6858-496c-bf30-b0a7f0d0efe9 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:44.695624 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-4b121b0b-2d92-4bce-bd51-edeceb2235fe req-cd5c4053-6858-496c-bf30-b0a7f0d0efe9 service nova] Creating event network-changed:70b5cda6-ca03-4f8e-a787-c270f412d879 for instance 33838c72-5e62-4317-ab27-5e45d243c3ec on hv-cinder-74216 Jul 04 04:26:44.702984 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-4b121b0b-2d92-4bce-bd51-edeceb2235fe req-cd5c4053-6858-496c-bf30-b0a7f0d0efe9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037665 Jul 04 04:26:44.703795 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 540/1057] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:26:44.711238 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-a00cbead-a0ab-4229-9c29-2d07c2c6c0d9 req-70465613-d5c8-4e96-b32d-e35f41b9d9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "676f9a50-d2ef-45c2-b4e9-5405721e1bfd", "name": "network-vif-plugged", "status": "completed", "tag": "eb69aec2-cc38-478b-9e7b-3ba07920e411"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:26:44.721395 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-a00cbead-a0ab-4229-9c29-2d07c2c6c0d9 req-70465613-d5c8-4e96-b32d-e35f41b9d9b7 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:44.722353 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-a00cbead-a0ab-4229-9c29-2d07c2c6c0d9 req-70465613-d5c8-4e96-b32d-e35f41b9d9b7 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:44.735930 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-a00cbead-a0ab-4229-9c29-2d07c2c6c0d9 req-70465613-d5c8-4e96-b32d-e35f41b9d9b7 service nova] Creating event network-vif-plugged:eb69aec2-cc38-478b-9e7b-3ba07920e411 for instance 676f9a50-d2ef-45c2-b4e9-5405721e1bfd on hv-cinder-74216 Jul 04 04:26:44.742893 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-a00cbead-a0ab-4229-9c29-2d07c2c6c0d9 req-70465613-d5c8-4e96-b32d-e35f41b9d9b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037340 Jul 04 04:26:44.743714 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 541/1058] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:26:44.860570 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7e14a167-35c4-40de-bcad-eaac5cbf0beb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:44.863966 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-bd9fa169-4f55-4735-8d93-06e4734c9a4c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:44.864734 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-bd9fa169-4f55-4735-8d93-06e4734c9a4c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:44.870287 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7e14a167-35c4-40de-bcad-eaac5cbf0beb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1362 microversion: 2.1 time: 0.286129 Jul 04 04:26:44.871705 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bd9fa169-4f55-4735-8d93-06e4734c9a4c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:44.872469 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bd9fa169-4f55-4735-8d93-06e4734c9a4c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:44.873547 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bd9fa169-4f55-4735-8d93-06e4734c9a4c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:44.874060 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-bd9fa169-4f55-4735-8d93-06e4734c9a4c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:44.880946 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 518/1059] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:44 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1362 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:45.037566 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-bd9fa169-4f55-4735-8d93-06e4734c9a4c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:45.046334 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-bd9fa169-4f55-4735-8d93-06e4734c9a4c tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 200 len: 1313 microversion: 2.1 time: 0.187834 Jul 04 04:26:45.047283 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 542/1060] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:44 2022] GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:45.183910 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f3d45829-003f-4d3d-b7a8-622c23ab33dd tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:45.184521 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f3d45829-003f-4d3d-b7a8-622c23ab33dd tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:45.191692 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3d45829-003f-4d3d-b7a8-622c23ab33dd tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:45.192433 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3d45829-003f-4d3d-b7a8-622c23ab33dd tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:45.193350 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3d45829-003f-4d3d-b7a8-622c23ab33dd tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:45.193783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3d45829-003f-4d3d-b7a8-622c23ab33dd tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:45.448844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f3d45829-003f-4d3d-b7a8-622c23ab33dd tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:45.457234 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f3d45829-003f-4d3d-b7a8-622c23ab33dd tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1578 microversion: 2.1 time: 0.277103 Jul 04 04:26:45.457827 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 519/1061] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:45 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1578 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:45.888868 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d36eb1a0-991a-4a74-b6a2-520470d8b4b8 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:45.889491 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d36eb1a0-991a-4a74-b6a2-520470d8b4b8 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:45.893223 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:26:45.900524 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d36eb1a0-991a-4a74-b6a2-520470d8b4b8 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:45.901096 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d36eb1a0-991a-4a74-b6a2-520470d8b4b8 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:45.901947 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d36eb1a0-991a-4a74-b6a2-520470d8b4b8 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:45.902470 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d36eb1a0-991a-4a74-b6a2-520470d8b4b8 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:46.046303 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d36eb1a0-991a-4a74-b6a2-520470d8b4b8 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:46.054160 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d36eb1a0-991a-4a74-b6a2-520470d8b4b8 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1362 microversion: 2.1 time: 0.169503 Jul 04 04:26:46.054808 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 543/1062] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:45 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:46.063428 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-098bb220-a93b-49f0-8777-c79424817536 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:46.064034 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-098bb220-a93b-49f0-8777-c79424817536 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:46.072616 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-098bb220-a93b-49f0-8777-c79424817536 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:46.073286 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-098bb220-a93b-49f0-8777-c79424817536 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:46.074498 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-098bb220-a93b-49f0-8777-c79424817536 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:46.075148 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-098bb220-a93b-49f0-8777-c79424817536 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:46.390646 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-098bb220-a93b-49f0-8777-c79424817536 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:46.403430 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-098bb220-a93b-49f0-8777-c79424817536 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 200 len: 1313 microversion: 2.1 time: 0.343850 Jul 04 04:26:46.404026 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 520/1063] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:46 2022] GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:46.474804 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-cb3c7d55-861e-4564-a1f0-fb50389b8f2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:46.476427 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-cb3c7d55-861e-4564-a1f0-fb50389b8f2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:46.484944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cb3c7d55-861e-4564-a1f0-fb50389b8f2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:46.485780 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cb3c7d55-861e-4564-a1f0-fb50389b8f2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:46.486829 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cb3c7d55-861e-4564-a1f0-fb50389b8f2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:46.487586 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-cb3c7d55-861e-4564-a1f0-fb50389b8f2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:46.675080 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-cb3c7d55-861e-4564-a1f0-fb50389b8f2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:46.685797 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-cb3c7d55-861e-4564-a1f0-fb50389b8f2b tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1578 microversion: 2.1 time: 0.215552 Jul 04 04:26:46.698509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 544/1064] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:46 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1578 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:47.079634 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b644d202-908b-43bb-920b-e4ecd06006b9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:47.081418 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b644d202-908b-43bb-920b-e4ecd06006b9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:47.089528 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b644d202-908b-43bb-920b-e4ecd06006b9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:47.090289 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b644d202-908b-43bb-920b-e4ecd06006b9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:47.091327 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b644d202-908b-43bb-920b-e4ecd06006b9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:47.091984 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b644d202-908b-43bb-920b-e4ecd06006b9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:47.421300 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-673dcb97-2fb3-4400-8cbf-bd6d5fddf8dd tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:47.422636 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-673dcb97-2fb3-4400-8cbf-bd6d5fddf8dd tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:47.442616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-673dcb97-2fb3-4400-8cbf-bd6d5fddf8dd tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:47.443346 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-673dcb97-2fb3-4400-8cbf-bd6d5fddf8dd tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:47.444217 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-673dcb97-2fb3-4400-8cbf-bd6d5fddf8dd tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:47.444666 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-673dcb97-2fb3-4400-8cbf-bd6d5fddf8dd tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:47.477012 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:26:47.503932 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=12 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:26:47.549464 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b644d202-908b-43bb-920b-e4ecd06006b9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:47.568650 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b644d202-908b-43bb-920b-e4ecd06006b9 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1362 microversion: 2.1 time: 0.492927 Jul 04 04:26:47.570576 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 521/1065] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:47 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1362 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:47.690092 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=8 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:26:47.707105 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1b58081a-5cd1-47df-9cdf-e1bd63cccaf4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:47.708362 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1b58081a-5cd1-47df-9cdf-e1bd63cccaf4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:47.715301 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b58081a-5cd1-47df-9cdf-e1bd63cccaf4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:47.716072 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b58081a-5cd1-47df-9cdf-e1bd63cccaf4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:47.719649 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b58081a-5cd1-47df-9cdf-e1bd63cccaf4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:47.720346 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b58081a-5cd1-47df-9cdf-e1bd63cccaf4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:47.808184 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-673dcb97-2fb3-4400-8cbf-bd6d5fddf8dd tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:47.821629 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-673dcb97-2fb3-4400-8cbf-bd6d5fddf8dd tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 200 len: 1313 microversion: 2.1 time: 0.403267 Jul 04 04:26:47.823829 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 545/1066] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:47 2022] GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:47.928002 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-c74f5760-420a-4d3f-8b67-b7d862665969 req-af1215c2-8e84-4d7c-bafd-3f9a2e523684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc477aae-9332-481d-bb4f-d1d8ff671c43", "name": "network-vif-deleted", "tag": "9a95c8cb-e9e6-4776-92fc-f9a7a4174643"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:26:47.937725 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-c74f5760-420a-4d3f-8b67-b7d862665969 req-af1215c2-8e84-4d7c-bafd-3f9a2e523684 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:47.938477 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-c74f5760-420a-4d3f-8b67-b7d862665969 req-af1215c2-8e84-4d7c-bafd-3f9a2e523684 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:47.954298 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-c74f5760-420a-4d3f-8b67-b7d862665969 req-af1215c2-8e84-4d7c-bafd-3f9a2e523684 service nova] Creating event network-vif-deleted:9a95c8cb-e9e6-4776-92fc-f9a7a4174643 for instance dc477aae-9332-481d-bb4f-d1d8ff671c43 on hv-cinder-74216 Jul 04 04:26:47.959772 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-c74f5760-420a-4d3f-8b67-b7d862665969 req-af1215c2-8e84-4d7c-bafd-3f9a2e523684 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035996 Jul 04 04:26:47.963901 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 546/1067] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:26:48.336447 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1b58081a-5cd1-47df-9cdf-e1bd63cccaf4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:48.346229 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1b58081a-5cd1-47df-9cdf-e1bd63cccaf4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1459 microversion: 2.1 time: 0.642943 Jul 04 04:26:48.357632 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 522/1068] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:47 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1459 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:48.593070 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b84d8a3d-b901-42f6-b66d-e4830326ddbb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:48.595471 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b84d8a3d-b901-42f6-b66d-e4830326ddbb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:48.605469 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b84d8a3d-b901-42f6-b66d-e4830326ddbb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:48.606233 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b84d8a3d-b901-42f6-b66d-e4830326ddbb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:48.607264 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b84d8a3d-b901-42f6-b66d-e4830326ddbb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:48.607765 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b84d8a3d-b901-42f6-b66d-e4830326ddbb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:48.793531 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b84d8a3d-b901-42f6-b66d-e4830326ddbb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:48.802144 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b84d8a3d-b901-42f6-b66d-e4830326ddbb tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1362 microversion: 2.1 time: 0.218228 Jul 04 04:26:48.803447 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 547/1069] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:48 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:48.840917 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-460f16c6-a4b8-4265-b37d-233a747ec63a tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:48.841548 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-460f16c6-a4b8-4265-b37d-233a747ec63a tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:48.847897 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-460f16c6-a4b8-4265-b37d-233a747ec63a tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:48.848340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-460f16c6-a4b8-4265-b37d-233a747ec63a tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:48.849295 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-460f16c6-a4b8-4265-b37d-233a747ec63a tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:48.849744 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-460f16c6-a4b8-4265-b37d-233a747ec63a tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:49.062755 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-460f16c6-a4b8-4265-b37d-233a747ec63a tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:49.071348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-460f16c6-a4b8-4265-b37d-233a747ec63a tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 200 len: 1313 microversion: 2.1 time: 0.234267 Jul 04 04:26:49.072472 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 523/1070] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:48 2022] GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:49.365191 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-fd5a2396-821b-4918-9fb0-741942187e67 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:49.365864 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-fd5a2396-821b-4918-9fb0-741942187e67 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:49.374912 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fd5a2396-821b-4918-9fb0-741942187e67 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:49.375360 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fd5a2396-821b-4918-9fb0-741942187e67 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:49.376339 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fd5a2396-821b-4918-9fb0-741942187e67 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:49.377088 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fd5a2396-821b-4918-9fb0-741942187e67 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:49.414865 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fd5a2396-821b-4918-9fb0-741942187e67 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:49.415570 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-fd5a2396-821b-4918-9fb0-741942187e67 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:49.416184 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.objects.instance [None req-fd5a2396-821b-4918-9fb0-741942187e67 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lazy-loading 'fault' on Instance uuid dc477aae-9332-481d-bb4f-d1d8ff671c43 {{(pid=117875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:26:49.475337 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-fd5a2396-821b-4918-9fb0-741942187e67 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:49.484752 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-fd5a2396-821b-4918-9fb0-741942187e67 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 200 len: 1231 microversion: 2.1 time: 0.123613 Jul 04 04:26:49.486011 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 548/1071] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:49 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 1231 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:49.539596 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-3b27ed50-8ff8-45a1-b02f-12a31de32d06 req-3648e15e-e991-4cf2-b18d-1b8d54a6aa6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33838c72-5e62-4317-ab27-5e45d243c3ec", "name": "network-vif-plugged", "status": "completed", "tag": "70b5cda6-ca03-4f8e-a787-c270f412d879"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:26:49.549432 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-3b27ed50-8ff8-45a1-b02f-12a31de32d06 req-3648e15e-e991-4cf2-b18d-1b8d54a6aa6c service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:49.550523 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-3b27ed50-8ff8-45a1-b02f-12a31de32d06 req-3648e15e-e991-4cf2-b18d-1b8d54a6aa6c service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:49.565826 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-3b27ed50-8ff8-45a1-b02f-12a31de32d06 req-3648e15e-e991-4cf2-b18d-1b8d54a6aa6c service nova] Creating event network-vif-plugged:70b5cda6-ca03-4f8e-a787-c270f412d879 for instance 33838c72-5e62-4317-ab27-5e45d243c3ec on hv-cinder-74216 Jul 04 04:26:49.571757 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-3b27ed50-8ff8-45a1-b02f-12a31de32d06 req-3648e15e-e991-4cf2-b18d-1b8d54a6aa6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035896 Jul 04 04:26:49.572623 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 524/1072] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:26:49.820585 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7415f140-cfdf-4a8f-9046-2f63a40f3611 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:49.822499 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7415f140-cfdf-4a8f-9046-2f63a40f3611 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:49.829762 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7415f140-cfdf-4a8f-9046-2f63a40f3611 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:49.830231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7415f140-cfdf-4a8f-9046-2f63a40f3611 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:49.831074 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7415f140-cfdf-4a8f-9046-2f63a40f3611 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:49.831509 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7415f140-cfdf-4a8f-9046-2f63a40f3611 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:50.004330 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7415f140-cfdf-4a8f-9046-2f63a40f3611 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:50.012543 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7415f140-cfdf-4a8f-9046-2f63a40f3611 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1362 microversion: 2.1 time: 0.196904 Jul 04 04:26:50.014974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 549/1073] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:49 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:50.089796 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8eadfd28-446b-4f79-b1bf-eb5fb97442c1 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:50.090579 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8eadfd28-446b-4f79-b1bf-eb5fb97442c1 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:50.098745 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8eadfd28-446b-4f79-b1bf-eb5fb97442c1 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:50.099194 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8eadfd28-446b-4f79-b1bf-eb5fb97442c1 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:50.099995 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8eadfd28-446b-4f79-b1bf-eb5fb97442c1 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:50.100430 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8eadfd28-446b-4f79-b1bf-eb5fb97442c1 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:50.352689 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8eadfd28-446b-4f79-b1bf-eb5fb97442c1 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:50.365473 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8eadfd28-446b-4f79-b1bf-eb5fb97442c1 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 200 len: 1496 microversion: 2.1 time: 0.280192 Jul 04 04:26:50.366087 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 525/1074] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:50 2022] GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 1496 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:50.503272 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d0326af1-c41a-4ee2-861e-5774c66c4b06 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:50.503939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d0326af1-c41a-4ee2-861e-5774c66c4b06 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: dc477aae-9332-481d-bb4f-d1d8ff671c43] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:50.511575 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d0326af1-c41a-4ee2-861e-5774c66c4b06 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:50.511944 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d0326af1-c41a-4ee2-861e-5774c66c4b06 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:50.513127 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d0326af1-c41a-4ee2-861e-5774c66c4b06 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:50.513738 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d0326af1-c41a-4ee2-861e-5774c66c4b06 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:50.530210 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-d0326af1-c41a-4ee2-861e-5774c66c4b06 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] HTTP exception thrown: Instance dc477aae-9332-481d-bb4f-d1d8ff671c43 could not be found. Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d0326af1-c41a-4ee2-861e-5774c66c4b06 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Request method failure captured: Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 HTTP/1.1 Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmnxZ0QXBxE2O90vGpLD26PhoGwtTx6MB7Etczz8f1dMUcriFIVAyImIsWs46fp50rBtP1LUDkrXci_RbYSL8uCi081BiK3i334uDcLCBi1q2-3E6HomyJxGcv6D7S4lMMhGrMT1Fa_Z6kuJFOV8EZfolEkzW3RGWUucV_Hgi7cgfpY Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: b622ab692a73432784c63b9ad3290e72 Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-TestVolumeBootPattern-836926993 Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:26:50.532231 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:26:50.534460 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b622ab692a73432784c63b9ad3290e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b622ab692a73432784c63b9ad3290e72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b622ab692a73432784c63b9ad3290e72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b622ab692a73432784c63b9ad3290e72", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:26:50.534460 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-TestVolumeBootPattern-836926993 Jul 04 04:26:50.534460 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: b622ab692a73432784c63b9ad3290e72 Jul 04 04:26:50.534460 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-TestVolumeBootPattern-836926993 Jul 04 04:26:50.534460 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-TestVolumeBootPattern-836926993-project Jul 04 04:26:50.534460 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:26:50.534460 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:26:50.534460 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 34ec54486c9d404896f832b87f99bc11 Jul 04 04:26:50.534460 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-TestVolumeBootPattern-836926993-project Jul 04 04:26:50.534460 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:26:50.534460 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance dc477aae-9332-481d-bb4f-d1d8ff671c43 could not be found. Jul 04 04:26:50.534460 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': 'dc477aae-9332-481d-bb4f-d1d8ff671c43'} Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc477aae-9332-481d-bb4f-d1d8ff671c43 could not be found. Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:26:50.535446 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:26:50.537008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:26:50.537008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:26:50.537008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:26:50.537008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:26:50.537008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:26:50.537008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:26:50.537008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:26:50.537008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc477aae-9332-481d-bb4f-d1d8ff671c43 could not be found. Jul 04 04:26:50.537008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:26:50.537008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:26:50.537008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:26:50.537008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:26:50.537008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:26:50.537008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:26:50.537008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:26:50.537008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:26:50.537008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc477aae-9332-481d-bb4f-d1d8ff671c43 could not be found. Jul 04 04:26:50.537008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:26:50.539506 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d0326af1-c41a-4ee2-861e-5774c66c4b06 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Returning 404 to user: Instance dc477aae-9332-481d-bb4f-d1d8ff671c43 could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:26:50.540564 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d0326af1-c41a-4ee2-861e-5774c66c4b06 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43" status: 404 len: 111 microversion: 2.1 time: 0.042402 Jul 04 04:26:50.541315 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 550/1075] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:50 2022] GET /compute/v2.1/servers/dc477aae-9332-481d-bb4f-d1d8ff671c43 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:26:51.057386 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f7658509-7076-4310-9b99-96128ee454d7 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:51.059115 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f7658509-7076-4310-9b99-96128ee454d7 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:51.069627 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f7658509-7076-4310-9b99-96128ee454d7 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:51.070423 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f7658509-7076-4310-9b99-96128ee454d7 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:51.071620 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f7658509-7076-4310-9b99-96128ee454d7 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:51.072424 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f7658509-7076-4310-9b99-96128ee454d7 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:51.103683 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=100 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:26:51.114879 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f7658509-7076-4310-9b99-96128ee454d7 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Going to try to terminate instance {{(pid=117875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:26:51.243343 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-f7658509-7076-4310-9b99-96128ee454d7 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "DELETE /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 204 len: 0 microversion: 2.1 time: 0.197491 Jul 04 04:26:51.248604 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 551/1076] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:26:51 2022] DELETE /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:26:51.255723 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-05d6e49c-2dc0-48ff-aa29-7f82e38db434 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:51.256441 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-05d6e49c-2dc0-48ff-aa29-7f82e38db434 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:51.264712 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-05d6e49c-2dc0-48ff-aa29-7f82e38db434 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:51.265157 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-05d6e49c-2dc0-48ff-aa29-7f82e38db434 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:51.266149 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-05d6e49c-2dc0-48ff-aa29-7f82e38db434 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:51.266768 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-05d6e49c-2dc0-48ff-aa29-7f82e38db434 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:51.390159 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4d88bf38-ca84-4185-8baf-a054ced46b63 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:51.390986 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4d88bf38-ca84-4185-8baf-a054ced46b63 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:51.398524 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4d88bf38-ca84-4185-8baf-a054ced46b63 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:51.399029 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4d88bf38-ca84-4185-8baf-a054ced46b63 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:51.400060 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4d88bf38-ca84-4185-8baf-a054ced46b63 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:51.400523 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4d88bf38-ca84-4185-8baf-a054ced46b63 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:51.526008 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-05d6e49c-2dc0-48ff-aa29-7f82e38db434 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:51.539581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-05d6e49c-2dc0-48ff-aa29-7f82e38db434 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 200 len: 1502 microversion: 2.1 time: 0.288778 Jul 04 04:26:51.540169 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 552/1077] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:51 2022] GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 1502 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:51.656989 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4d88bf38-ca84-4185-8baf-a054ced46b63 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:51.665982 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4d88bf38-ca84-4185-8baf-a054ced46b63 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1362 microversion: 2.1 time: 0.638784 Jul 04 04:26:51.666604 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 526/1078] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:51 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1362 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:52.572725 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9f388ee0-e7a5-49cd-8b89-18b7b7676a9f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:52.574158 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-9f388ee0-e7a5-49cd-8b89-18b7b7676a9f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:52.582076 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9f388ee0-e7a5-49cd-8b89-18b7b7676a9f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:52.582749 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9f388ee0-e7a5-49cd-8b89-18b7b7676a9f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:52.583695 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9f388ee0-e7a5-49cd-8b89-18b7b7676a9f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:52.584278 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9f388ee0-e7a5-49cd-8b89-18b7b7676a9f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:52.683504 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-651f5f9f-ec66-49cf-b5c8-f4cab0bffba7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:52.684242 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-651f5f9f-ec66-49cf-b5c8-f4cab0bffba7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:52.701379 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-651f5f9f-ec66-49cf-b5c8-f4cab0bffba7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:52.701853 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-651f5f9f-ec66-49cf-b5c8-f4cab0bffba7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:52.702733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-651f5f9f-ec66-49cf-b5c8-f4cab0bffba7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:52.703167 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-651f5f9f-ec66-49cf-b5c8-f4cab0bffba7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:52.770252 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9f388ee0-e7a5-49cd-8b89-18b7b7676a9f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:52.779203 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9f388ee0-e7a5-49cd-8b89-18b7b7676a9f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 200 len: 1502 microversion: 2.1 time: 0.222745 Jul 04 04:26:52.779821 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 553/1079] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:52 2022] GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 1502 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:53.511541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-651f5f9f-ec66-49cf-b5c8-f4cab0bffba7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:53.546216 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-651f5f9f-ec66-49cf-b5c8-f4cab0bffba7 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1362 microversion: 2.1 time: 0.863554 Jul 04 04:26:53.550145 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 527/1080] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:52 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1362 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:26:53.797946 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e32a09a0-9dc6-4c4a-8d2c-87e2a929f0df tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:53.799984 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e32a09a0-9dc6-4c4a-8d2c-87e2a929f0df tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:53.808895 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e32a09a0-9dc6-4c4a-8d2c-87e2a929f0df tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:53.809346 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e32a09a0-9dc6-4c4a-8d2c-87e2a929f0df tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:53.811351 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e32a09a0-9dc6-4c4a-8d2c-87e2a929f0df tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:53.812657 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e32a09a0-9dc6-4c4a-8d2c-87e2a929f0df tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:54.090498 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e32a09a0-9dc6-4c4a-8d2c-87e2a929f0df tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:54.099224 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e32a09a0-9dc6-4c4a-8d2c-87e2a929f0df tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 200 len: 1502 microversion: 2.1 time: 0.305692 Jul 04 04:26:54.100447 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 554/1081] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:53 2022] GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 1502 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:54.287832 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-83b94668-c7f1-46b2-8bda-f0dad0e15c4a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:54.288373 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-83b94668-c7f1-46b2-8bda-f0dad0e15c4a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:54.295992 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-11544532-a0b7-4e95-b86f-d80814348725 req-f0854f63-700b-4000-abe4-da2a5b43d8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e07bec57-64a0-4669-9cb5-6d54d72b8f20", "tag": "2bb1a3cb-fe02-4fa0-814e-4fcbd93520ba"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:26:54.306077 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83b94668-c7f1-46b2-8bda-f0dad0e15c4a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:54.306558 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83b94668-c7f1-46b2-8bda-f0dad0e15c4a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:54.307348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83b94668-c7f1-46b2-8bda-f0dad0e15c4a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:54.307796 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83b94668-c7f1-46b2-8bda-f0dad0e15c4a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:54.317810 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-11544532-a0b7-4e95-b86f-d80814348725 req-f0854f63-700b-4000-abe4-da2a5b43d8a0 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:54.321427 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-11544532-a0b7-4e95-b86f-d80814348725 req-f0854f63-700b-4000-abe4-da2a5b43d8a0 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:54.337269 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-11544532-a0b7-4e95-b86f-d80814348725 req-f0854f63-700b-4000-abe4-da2a5b43d8a0 service nova] Creating event network-changed:2bb1a3cb-fe02-4fa0-814e-4fcbd93520ba for instance e07bec57-64a0-4669-9cb5-6d54d72b8f20 on hv-cinder-74216 Jul 04 04:26:54.342999 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-11544532-a0b7-4e95-b86f-d80814348725 req-f0854f63-700b-4000-abe4-da2a5b43d8a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050846 Jul 04 04:26:54.345204 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 555/1082] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:26:54.352116 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-83b94668-c7f1-46b2-8bda-f0dad0e15c4a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:26:54.391839 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:26:54.455131 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-83b94668-c7f1-46b2-8bda-f0dad0e15c4a tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 204 len: 0 microversion: 2.1 time: 0.171087 Jul 04 04:26:54.456101 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 528/1083] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:26:54 2022] DELETE /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:26:54.466308 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a9dd762d-ed77-487f-a39f-5ed34321df43 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:54.467368 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a9dd762d-ed77-487f-a39f-5ed34321df43 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:54.474833 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a9dd762d-ed77-487f-a39f-5ed34321df43 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:54.475185 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a9dd762d-ed77-487f-a39f-5ed34321df43 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:54.476076 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a9dd762d-ed77-487f-a39f-5ed34321df43 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:54.476557 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a9dd762d-ed77-487f-a39f-5ed34321df43 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:54.566499 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7fb8b9d4-c7aa-4aa6-8264-11552f8938c2 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:54.567318 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7fb8b9d4-c7aa-4aa6-8264-11552f8938c2 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:54.574932 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7fb8b9d4-c7aa-4aa6-8264-11552f8938c2 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:54.575702 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7fb8b9d4-c7aa-4aa6-8264-11552f8938c2 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:54.576690 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7fb8b9d4-c7aa-4aa6-8264-11552f8938c2 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:54.577330 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7fb8b9d4-c7aa-4aa6-8264-11552f8938c2 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:54.676235 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a9dd762d-ed77-487f-a39f-5ed34321df43 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:54.686847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a9dd762d-ed77-487f-a39f-5ed34321df43 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1575 microversion: 2.1 time: 0.225562 Jul 04 04:26:54.687570 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 556/1084] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:54 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1575 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:54.692626 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-4f2ffab0-85dc-4231-9c95-71ff378b8779 req-f8b4a973-05de-43e0-968c-18bf90f3ce64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "676f9a50-d2ef-45c2-b4e9-5405721e1bfd", "name": "network-vif-deleted", "tag": "eb69aec2-cc38-478b-9e7b-3ba07920e411"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:26:54.701135 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-4f2ffab0-85dc-4231-9c95-71ff378b8779 req-f8b4a973-05de-43e0-968c-18bf90f3ce64 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:54.701813 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-4f2ffab0-85dc-4231-9c95-71ff378b8779 req-f8b4a973-05de-43e0-968c-18bf90f3ce64 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:54.713388 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-4f2ffab0-85dc-4231-9c95-71ff378b8779 req-f8b4a973-05de-43e0-968c-18bf90f3ce64 service nova] Creating event network-vif-deleted:eb69aec2-cc38-478b-9e7b-3ba07920e411 for instance 676f9a50-d2ef-45c2-b4e9-5405721e1bfd on hv-cinder-74216 Jul 04 04:26:54.718552 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-4f2ffab0-85dc-4231-9c95-71ff378b8779 req-f8b4a973-05de-43e0-968c-18bf90f3ce64 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029544 Jul 04 04:26:54.719421 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 557/1085] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:26:54.927952 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7fb8b9d4-c7aa-4aa6-8264-11552f8938c2 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:54.940399 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7fb8b9d4-c7aa-4aa6-8264-11552f8938c2 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1548 microversion: 2.1 time: 0.378156 Jul 04 04:26:54.960723 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-78c76914-af55-4cca-b612-d3a38079030a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:54.961311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-78c76914-af55-4cca-b612-d3a38079030a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:54.968686 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 529/1086] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:54 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1548 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:26:54.986112 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-78c76914-af55-4cca-b612-d3a38079030a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:54.986632 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-78c76914-af55-4cca-b612-d3a38079030a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:54.987572 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-78c76914-af55-4cca-b612-d3a38079030a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:54.988006 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-78c76914-af55-4cca-b612-d3a38079030a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:55.117458 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-af876cb8-15d7-401b-9e76-fe606568cd65 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:55.118983 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-af876cb8-15d7-401b-9e76-fe606568cd65 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:55.132585 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af876cb8-15d7-401b-9e76-fe606568cd65 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:55.140945 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af876cb8-15d7-401b-9e76-fe606568cd65 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:55.143849 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af876cb8-15d7-401b-9e76-fe606568cd65 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:55.145594 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af876cb8-15d7-401b-9e76-fe606568cd65 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:55.229788 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af876cb8-15d7-401b-9e76-fe606568cd65 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:55.230152 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af876cb8-15d7-401b-9e76-fe606568cd65 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:55.230702 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-af876cb8-15d7-401b-9e76-fe606568cd65 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lazy-loading 'fault' on Instance uuid 676f9a50-d2ef-45c2-b4e9-5405721e1bfd {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:26:55.290175 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-af876cb8-15d7-401b-9e76-fe606568cd65 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f505d44f601474aafa4ee57e71588a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd770140713d34c5ab7c8775e5e9837fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:55.299182 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-af876cb8-15d7-401b-9e76-fe606568cd65 tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 200 len: 1303 microversion: 2.1 time: 0.186035 Jul 04 04:26:55.310595 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 530/1087] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:55 2022] GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 1303 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:55.327579 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-78c76914-af55-4cca-b612-d3a38079030a tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.372461 Jul 04 04:26:55.328372 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 558/1088] 10.222.0.16 () {58 vars in 1274 bytes} [Mon Jul 4 04:26:54 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-interface => generated 284 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:26:55.704699 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-37740810-5935-4d3f-81c3-83549a5987cc tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:55.705819 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-37740810-5935-4d3f-81c3-83549a5987cc tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:55.715025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37740810-5935-4d3f-81c3-83549a5987cc tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:55.716253 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37740810-5935-4d3f-81c3-83549a5987cc tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:55.722473 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37740810-5935-4d3f-81c3-83549a5987cc tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:55.723353 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37740810-5935-4d3f-81c3-83549a5987cc tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:56.318174 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5033b3e5-0396-4c7b-be44-56b3b001bd4f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:56.319749 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-5033b3e5-0396-4c7b-be44-56b3b001bd4f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] [instance: 676f9a50-d2ef-45c2-b4e9-5405721e1bfd] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:56.336657 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5033b3e5-0396-4c7b-be44-56b3b001bd4f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:56.337120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5033b3e5-0396-4c7b-be44-56b3b001bd4f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:56.340184 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5033b3e5-0396-4c7b-be44-56b3b001bd4f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:56.340658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-5033b3e5-0396-4c7b-be44-56b3b001bd4f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:56.379645 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-5033b3e5-0396-4c7b-be44-56b3b001bd4f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] HTTP exception thrown: Instance 676f9a50-d2ef-45c2-b4e9-5405721e1bfd could not be found. Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5033b3e5-0396-4c7b-be44-56b3b001bd4f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Request method failure captured: Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd HTTP/1.1 Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmvk0MFRhT05Wvq6NYOuVIc96ODLSqTJmtglHhaSruDEpM6zvAhHvonnNYzfr45_Y-y6hAGBtM8vL4qTS69vXYiekP9oBXh89WF5Y5M1_KH-K-qoMX4d8ng3okfD-DPtOgpg7F4oC0XchvgP2Myq2zIp0EkDuVBSw9haMd6xJXsg4m0 Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: d770140713d34c5ab7c8775e5e9837fa Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-VolumesActionsTest-1902097920 Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:26:56.381410 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:26:56.383253 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d770140713d34c5ab7c8775e5e9837fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d770140713d34c5ab7c8775e5e9837fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d770140713d34c5ab7c8775e5e9837fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d770140713d34c5ab7c8775e5e9837fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:26:56.383253 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-VolumesActionsTest-1902097920 Jul 04 04:26:56.383253 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: d770140713d34c5ab7c8775e5e9837fa Jul 04 04:26:56.383253 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-VolumesActionsTest-1902097920 Jul 04 04:26:56.383253 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-VolumesActionsTest-1902097920-project Jul 04 04:26:56.383253 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:26:56.383253 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:26:56.383253 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 3f505d44f601474aafa4ee57e71588a7 Jul 04 04:26:56.383253 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-VolumesActionsTest-1902097920-project Jul 04 04:26:56.383253 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:26:56.383253 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance 676f9a50-d2ef-45c2-b4e9-5405721e1bfd could not be found. Jul 04 04:26:56.383253 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': '676f9a50-d2ef-45c2-b4e9-5405721e1bfd'} Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 676f9a50-d2ef-45c2-b4e9-5405721e1bfd could not be found. Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:26:56.384525 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:26:56.385809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:26:56.385809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:26:56.385809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:26:56.385809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:26:56.385809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:26:56.385809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:26:56.385809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:26:56.385809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 676f9a50-d2ef-45c2-b4e9-5405721e1bfd could not be found. Jul 04 04:26:56.385809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:26:56.385809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:26:56.385809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:26:56.385809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:26:56.385809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:26:56.385809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:26:56.385809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:26:56.385809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:26:56.385809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 676f9a50-d2ef-45c2-b4e9-5405721e1bfd could not be found. Jul 04 04:26:56.385809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:26:56.387788 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-5033b3e5-0396-4c7b-be44-56b3b001bd4f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] Returning 404 to user: Instance 676f9a50-d2ef-45c2-b4e9-5405721e1bfd could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:26:56.387788 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-5033b3e5-0396-4c7b-be44-56b3b001bd4f tempest-VolumesActionsTest-1902097920 tempest-VolumesActionsTest-1902097920-project] 10.222.0.16 "GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd" status: 404 len: 111 microversion: 2.1 time: 0.070194 Jul 04 04:26:56.387788 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 559/1089] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:56 2022] GET /compute/v2.1/servers/676f9a50-d2ef-45c2-b4e9-5405721e1bfd => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 04:26:56.742449 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-37740810-5935-4d3f-81c3-83549a5987cc tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:56.753753 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-37740810-5935-4d3f-81c3-83549a5987cc tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1575 microversion: 2.1 time: 1.052933 Jul 04 04:26:56.754345 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 531/1090] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:55 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1575 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:57.758180 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-6c5db1ab-0dcb-4765-9415-b623e95e3550 req-985a9702-c0fd-4cbe-b59e-d8d15b283b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e07bec57-64a0-4669-9cb5-6d54d72b8f20", "name": "network-vif-deleted", "tag": "2bb1a3cb-fe02-4fa0-814e-4fcbd93520ba"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:26:57.775143 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f02784fe-568c-4bc1-9fce-96d4c13111b4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:57.787010 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-6c5db1ab-0dcb-4765-9415-b623e95e3550 req-985a9702-c0fd-4cbe-b59e-d8d15b283b31 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:57.789501 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f02784fe-568c-4bc1-9fce-96d4c13111b4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:57.790065 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-6c5db1ab-0dcb-4765-9415-b623e95e3550 req-985a9702-c0fd-4cbe-b59e-d8d15b283b31 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:57.803202 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f02784fe-568c-4bc1-9fce-96d4c13111b4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:57.803655 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f02784fe-568c-4bc1-9fce-96d4c13111b4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:57.804556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f02784fe-568c-4bc1-9fce-96d4c13111b4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:57.806732 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f02784fe-568c-4bc1-9fce-96d4c13111b4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:57.811876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-6c5db1ab-0dcb-4765-9415-b623e95e3550 req-985a9702-c0fd-4cbe-b59e-d8d15b283b31 service nova] Creating event network-vif-deleted:2bb1a3cb-fe02-4fa0-814e-4fcbd93520ba for instance e07bec57-64a0-4669-9cb5-6d54d72b8f20 on hv-cinder-74216 Jul 04 04:26:57.821003 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-6c5db1ab-0dcb-4765-9415-b623e95e3550 req-985a9702-c0fd-4cbe-b59e-d8d15b283b31 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066638 Jul 04 04:26:57.822738 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 560/1091] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:26:57.907894 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f02784fe-568c-4bc1-9fce-96d4c13111b4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:57.917731 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f02784fe-568c-4bc1-9fce-96d4c13111b4 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1225 microversion: 2.1 time: 0.147859 Jul 04 04:26:57.918930 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 532/1092] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:57 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1225 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:58.082546 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-fc11e741-7460-43ba-807e-88a3e2f3a29f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Action: 'create', calling method: .version_select at 0x7f50c5930ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-655930833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAMa3qeJ8QXxQ7HsMwwmz0c2fKTojutKVyQrGPLCtSB1rf1zlk2k3S1abpqLi3kXMJ81GmFjd68sXdfWG4e+jwmpcxUpcX5j/O9CRMDiO5hVdnnVj2MgCzEnMJav/0+uA=="}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:26:58.099046 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-fc11e741-7460-43ba-807e-88a3e2f3a29f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Getting quotas for project 4bb5a1e0698348739f44376f82c933ad. Resources: {'key_pairs'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:26:58.103153 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-fc11e741-7460-43ba-807e-88a3e2f3a29f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Getting quotas for user b8158ebeedf7438b9e3306186c1898cd and project 4bb5a1e0698348739f44376f82c933ad. Resources: {'key_pairs'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:26:58.126679 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-fc11e741-7460-43ba-807e-88a3e2f3a29f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.165323 Jul 04 04:26:58.127286 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 561/1093] 10.222.0.16 () {60 vars in 1158 bytes} [Mon Jul 4 04:26:57 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:26:58.935310 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-53e6b344-9385-44e0-96fc-530ef3718efb tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:26:58.935909 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-53e6b344-9385-44e0-96fc-530ef3718efb tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:26:58.942245 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53e6b344-9385-44e0-96fc-530ef3718efb tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:58.942740 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53e6b344-9385-44e0-96fc-530ef3718efb tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:58.943512 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53e6b344-9385-44e0-96fc-530ef3718efb tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:58.943936 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53e6b344-9385-44e0-96fc-530ef3718efb tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:59.012416 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-53e6b344-9385-44e0-96fc-530ef3718efb tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:26:59.020276 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-53e6b344-9385-44e0-96fc-530ef3718efb tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1225 microversion: 2.1 time: 0.088955 Jul 04 04:26:59.021126 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 533/1094] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:26:58 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:26:59.842793 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-bedcba1a-10a6-4382-907c-ee2748dc3479 req-a186f150-f55e-4972-b38e-cb0cd6124cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33838c72-5e62-4317-ab27-5e45d243c3ec", "tag": "70b5cda6-ca03-4f8e-a787-c270f412d879"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:26:59.853284 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-bedcba1a-10a6-4382-907c-ee2748dc3479 req-a186f150-f55e-4972-b38e-cb0cd6124cc4 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:26:59.853730 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-bedcba1a-10a6-4382-907c-ee2748dc3479 req-a186f150-f55e-4972-b38e-cb0cd6124cc4 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:26:59.865697 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-bedcba1a-10a6-4382-907c-ee2748dc3479 req-a186f150-f55e-4972-b38e-cb0cd6124cc4 service nova] Creating event network-changed:70b5cda6-ca03-4f8e-a787-c270f412d879 for instance 33838c72-5e62-4317-ab27-5e45d243c3ec on hv-cinder-74216 Jul 04 04:26:59.871101 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-bedcba1a-10a6-4382-907c-ee2748dc3479 req-a186f150-f55e-4972-b38e-cb0cd6124cc4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032589 Jul 04 04:26:59.871614 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 562/1095] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:27:00.037908 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-68f7db4f-cec4-4960-98f5-95bb2f7dfe18 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:00.038516 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-68f7db4f-cec4-4960-98f5-95bb2f7dfe18 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:00.045473 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68f7db4f-cec4-4960-98f5-95bb2f7dfe18 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:00.046219 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68f7db4f-cec4-4960-98f5-95bb2f7dfe18 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:00.047015 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68f7db4f-cec4-4960-98f5-95bb2f7dfe18 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:00.047458 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68f7db4f-cec4-4960-98f5-95bb2f7dfe18 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:00.119930 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-68f7db4f-cec4-4960-98f5-95bb2f7dfe18 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:00.128224 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-68f7db4f-cec4-4960-98f5-95bb2f7dfe18 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1225 microversion: 2.1 time: 0.094808 Jul 04 04:27:00.128736 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 534/1096] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:00 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:27:01.147428 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a5e95b55-cc65-4956-935a-5d0ad6002895 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:01.150500 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a5e95b55-cc65-4956-935a-5d0ad6002895 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:01.158061 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a5e95b55-cc65-4956-935a-5d0ad6002895 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:01.158635 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a5e95b55-cc65-4956-935a-5d0ad6002895 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:01.159911 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a5e95b55-cc65-4956-935a-5d0ad6002895 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:01.160172 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a5e95b55-cc65-4956-935a-5d0ad6002895 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:01.240835 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a5e95b55-cc65-4956-935a-5d0ad6002895 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:01.248778 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a5e95b55-cc65-4956-935a-5d0ad6002895 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1225 microversion: 2.1 time: 0.106514 Jul 04 04:27:01.249376 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 563/1097] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:01 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:27:02.267333 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6528ed4c-b53b-488a-ad3a-d5ca6a174e20 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:02.268040 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6528ed4c-b53b-488a-ad3a-d5ca6a174e20 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:02.274981 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6528ed4c-b53b-488a-ad3a-d5ca6a174e20 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:02.275427 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6528ed4c-b53b-488a-ad3a-d5ca6a174e20 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:02.276198 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6528ed4c-b53b-488a-ad3a-d5ca6a174e20 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:02.276633 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6528ed4c-b53b-488a-ad3a-d5ca6a174e20 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:02.343300 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6528ed4c-b53b-488a-ad3a-d5ca6a174e20 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ec54486c9d404896f832b87f99bc11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b622ab692a73432784c63b9ad3290e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:02.350862 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6528ed4c-b53b-488a-ad3a-d5ca6a174e20 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 200 len: 1225 microversion: 2.1 time: 0.087445 Jul 04 04:27:02.351416 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 535/1098] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:02 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:27:03.369898 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-db16662b-3e33-4b8e-b0b0-1991368bf04d tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:03.370931 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-db16662b-3e33-4b8e-b0b0-1991368bf04d tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: e07bec57-64a0-4669-9cb5-6d54d72b8f20] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:03.380422 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db16662b-3e33-4b8e-b0b0-1991368bf04d tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:03.381222 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db16662b-3e33-4b8e-b0b0-1991368bf04d tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:03.382549 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db16662b-3e33-4b8e-b0b0-1991368bf04d tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:03.384674 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-db16662b-3e33-4b8e-b0b0-1991368bf04d tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:03.406005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-db16662b-3e33-4b8e-b0b0-1991368bf04d tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] HTTP exception thrown: Instance e07bec57-64a0-4669-9cb5-6d54d72b8f20 could not be found. Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-db16662b-3e33-4b8e-b0b0-1991368bf04d tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Request method failure captured: Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 HTTP/1.1 Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmnxZ0QXBxE2O90vGpLD26PhoGwtTx6MB7Etczz8f1dMUcriFIVAyImIsWs46fp50rBtP1LUDkrXci_RbYSL8uCi081BiK3i334uDcLCBi1q2-3E6HomyJxGcv6D7S4lMMhGrMT1Fa_Z6kuJFOV8EZfolEkzW3RGWUucV_Hgi7cgfpY Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: b622ab692a73432784c63b9ad3290e72 Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-TestVolumeBootPattern-836926993 Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:27:03.408017 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:27:03.409926 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b622ab692a73432784c63b9ad3290e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b622ab692a73432784c63b9ad3290e72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b622ab692a73432784c63b9ad3290e72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b622ab692a73432784c63b9ad3290e72", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:27:03.409926 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-TestVolumeBootPattern-836926993 Jul 04 04:27:03.409926 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: b622ab692a73432784c63b9ad3290e72 Jul 04 04:27:03.409926 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-TestVolumeBootPattern-836926993 Jul 04 04:27:03.409926 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-TestVolumeBootPattern-836926993-project Jul 04 04:27:03.409926 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:27:03.409926 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:27:03.409926 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 34ec54486c9d404896f832b87f99bc11 Jul 04 04:27:03.409926 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-TestVolumeBootPattern-836926993-project Jul 04 04:27:03.409926 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:27:03.409926 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance e07bec57-64a0-4669-9cb5-6d54d72b8f20 could not be found. Jul 04 04:27:03.409926 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': 'e07bec57-64a0-4669-9cb5-6d54d72b8f20'} Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e07bec57-64a0-4669-9cb5-6d54d72b8f20 could not be found. Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:27:03.410756 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:27:03.412120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:27:03.412120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:27:03.412120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:27:03.412120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:27:03.412120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:27:03.412120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:27:03.412120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:27:03.412120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e07bec57-64a0-4669-9cb5-6d54d72b8f20 could not be found. Jul 04 04:27:03.412120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:27:03.412120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:27:03.412120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:27:03.412120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:27:03.412120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:27:03.412120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:27:03.412120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:27:03.412120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:27:03.412120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e07bec57-64a0-4669-9cb5-6d54d72b8f20 could not be found. Jul 04 04:27:03.412120 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:27:03.413363 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-db16662b-3e33-4b8e-b0b0-1991368bf04d tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Returning 404 to user: Instance e07bec57-64a0-4669-9cb5-6d54d72b8f20 could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:27:03.413363 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-db16662b-3e33-4b8e-b0b0-1991368bf04d tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20" status: 404 len: 111 microversion: 2.1 time: 0.045890 Jul 04 04:27:03.414091 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 564/1099] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:03 2022] GET /compute/v2.1/servers/e07bec57-64a0-4669-9cb5-6d54d72b8f20 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:27:03.975927 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a0968810-32b4-4a00-960f-04aee4d5ea60 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:03.976585 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a0968810-32b4-4a00-960f-04aee4d5ea60 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:03.983727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0968810-32b4-4a00-960f-04aee4d5ea60 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:03.984303 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0968810-32b4-4a00-960f-04aee4d5ea60 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:03.985305 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0968810-32b4-4a00-960f-04aee4d5ea60 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:03.985996 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0968810-32b4-4a00-960f-04aee4d5ea60 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:04.000169 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-a0968810-32b4-4a00-960f-04aee4d5ea60 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] HTTP exception thrown: Instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d could not be found. Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a0968810-32b4-4a00-960f-04aee4d5ea60 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Request method failure captured: Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d HTTP/1.1 Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmnxZ0QXBxE2O90vGpLD26PhoGwtTx6MB7Etczz8f1dMUcriFIVAyImIsWs46fp50rBtP1LUDkrXci_RbYSL8uCi081BiK3i334uDcLCBi1q2-3E6HomyJxGcv6D7S4lMMhGrMT1Fa_Z6kuJFOV8EZfolEkzW3RGWUucV_Hgi7cgfpY Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: b622ab692a73432784c63b9ad3290e72 Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-TestVolumeBootPattern-836926993 Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:27:04.002019 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:27:04.003839 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b622ab692a73432784c63b9ad3290e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b622ab692a73432784c63b9ad3290e72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b622ab692a73432784c63b9ad3290e72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b622ab692a73432784c63b9ad3290e72", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:27:04.003839 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-TestVolumeBootPattern-836926993 Jul 04 04:27:04.003839 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: b622ab692a73432784c63b9ad3290e72 Jul 04 04:27:04.003839 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-TestVolumeBootPattern-836926993 Jul 04 04:27:04.003839 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-TestVolumeBootPattern-836926993-project Jul 04 04:27:04.003839 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:27:04.003839 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:27:04.003839 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: 34ec54486c9d404896f832b87f99bc11 Jul 04 04:27:04.003839 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-TestVolumeBootPattern-836926993-project Jul 04 04:27:04.003839 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:27:04.003839 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d could not be found. Jul 04 04:27:04.003839 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': 'bc36b6d5-12c0-48bd-9aee-afdef9e38c2d'} Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d could not be found. Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:27:04.004774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d could not be found. Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d could not be found. Jul 04 04:27:04.006395 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:27:04.008454 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a0968810-32b4-4a00-960f-04aee4d5ea60 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Returning 404 to user: Instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:27:04.008454 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a0968810-32b4-4a00-960f-04aee4d5ea60 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 404 len: 111 microversion: 2.1 time: 0.034659 Jul 04 04:27:04.008454 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 536/1100] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:27:03 2022] DELETE /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:27:04.014068 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-4942b402-1423-4fcf-bcbd-9a27f1495469 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:04.015162 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-4942b402-1423-4fcf-bcbd-9a27f1495469 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] [instance: bc36b6d5-12c0-48bd-9aee-afdef9e38c2d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:04.022044 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4942b402-1423-4fcf-bcbd-9a27f1495469 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:04.022645 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4942b402-1423-4fcf-bcbd-9a27f1495469 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:04.023711 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4942b402-1423-4fcf-bcbd-9a27f1495469 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:04.024384 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4942b402-1423-4fcf-bcbd-9a27f1495469 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:04.040348 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-4942b402-1423-4fcf-bcbd-9a27f1495469 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] HTTP exception thrown: Instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d could not be found. Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-4942b402-1423-4fcf-bcbd-9a27f1495469 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Request method failure captured: Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d HTTP/1.1 Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmnxZ0QXBxE2O90vGpLD26PhoGwtTx6MB7Etczz8f1dMUcriFIVAyImIsWs46fp50rBtP1LUDkrXci_RbYSL8uCi081BiK3i334uDcLCBi1q2-3E6HomyJxGcv6D7S4lMMhGrMT1Fa_Z6kuJFOV8EZfolEkzW3RGWUucV_Hgi7cgfpY Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: b622ab692a73432784c63b9ad3290e72 Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-TestVolumeBootPattern-836926993 Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:27:04.042045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:27:04.043784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b622ab692a73432784c63b9ad3290e72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b622ab692a73432784c63b9ad3290e72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b622ab692a73432784c63b9ad3290e72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b622ab692a73432784c63b9ad3290e72", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:27:04.043784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-TestVolumeBootPattern-836926993 Jul 04 04:27:04.043784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: b622ab692a73432784c63b9ad3290e72 Jul 04 04:27:04.043784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-TestVolumeBootPattern-836926993 Jul 04 04:27:04.043784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-TestVolumeBootPattern-836926993-project Jul 04 04:27:04.043784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:27:04.043784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:27:04.043784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: 34ec54486c9d404896f832b87f99bc11 Jul 04 04:27:04.043784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-TestVolumeBootPattern-836926993-project Jul 04 04:27:04.043784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:27:04.043784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d could not be found. Jul 04 04:27:04.043784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': 'bc36b6d5-12c0-48bd-9aee-afdef9e38c2d'} Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d could not be found. Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:27:04.044671 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:27:04.047098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:27:04.047098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:27:04.047098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:27:04.047098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:27:04.047098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:27:04.047098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:27:04.047098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:27:04.047098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d could not be found. Jul 04 04:27:04.047098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:27:04.047098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:27:04.047098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:27:04.047098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:27:04.047098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:27:04.047098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:27:04.047098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:27:04.047098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:27:04.047098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d could not be found. Jul 04 04:27:04.047098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:27:04.048580 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-4942b402-1423-4fcf-bcbd-9a27f1495469 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Returning 404 to user: Instance bc36b6d5-12c0-48bd-9aee-afdef9e38c2d could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:27:04.048580 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-4942b402-1423-4fcf-bcbd-9a27f1495469 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d" status: 404 len: 111 microversion: 2.1 time: 0.034153 Jul 04 04:27:04.048580 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 565/1101] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:04 2022] GET /compute/v2.1/servers/bc36b6d5-12c0-48bd-9aee-afdef9e38c2d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:27:05.400377 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e9221e4c-33a2-489c-b4ed-6b83fedf9363 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] Calling method '.version_select at 0x7f50c0fda3a0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:05.427693 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e9221e4c-33a2-489c-b4ed-6b83fedf9363 tempest-TestVolumeBootPattern-836926993 tempest-TestVolumeBootPattern-836926993-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1321978684" status: 202 len: 0 microversion: 2.1 time: 0.044032 Jul 04 04:27:05.434323 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 537/1102] 10.222.0.16 () {58 vars in 1262 bytes} [Mon Jul 4 04:27:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1321978684 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:27:29.435050 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-65e7e79b-77a1-42f9-88a4-7e250a1ea524 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1657945055", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-655930833", "security_groups": [{"name": "tempest-secgroup-smoke-725198267"}], "networks": [{"uuid": "8e4fabad-0c05-43fb-b720-1bca27f96e1a"}], "block_device_mapping_v2": [{"uuid": "1e0d5661-9d4d-42e5-a328-5a03707743d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:27:29.443414 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=4 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:29.444104 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:29.444708 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:29.563302 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.network.neutron [None req-65e7e79b-77a1-42f9-88a4-7e250a1ea524 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] validate_networks() for [('8e4fabad-0c05-43fb-b720-1bca27f96e1a', None, None, None, None, None)] {{(pid=117875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:27:30.087955 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-65e7e79b-77a1-42f9-88a4-7e250a1ea524 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Flavor limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:27:30.089145 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-65e7e79b-77a1-42f9-88a4-7e250a1ea524 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Image limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:27:30.089819 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-65e7e79b-77a1-42f9-88a4-7e250a1ea524 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Flavor pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:27:30.090344 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-65e7e79b-77a1-42f9-88a4-7e250a1ea524 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Image pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:27:30.090936 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-65e7e79b-77a1-42f9-88a4-7e250a1ea524 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:27:30.104655 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-65e7e79b-77a1-42f9-88a4-7e250a1ea524 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:30.105096 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-65e7e79b-77a1-42f9-88a4-7e250a1ea524 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:30.105892 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-65e7e79b-77a1-42f9-88a4-7e250a1ea524 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:30.106328 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-65e7e79b-77a1-42f9-88a4-7e250a1ea524 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:30.123137 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-65e7e79b-77a1-42f9-88a4-7e250a1ea524 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Getting quotas for project 4bb5a1e0698348739f44376f82c933ad. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:27:30.127697 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-65e7e79b-77a1-42f9-88a4-7e250a1ea524 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Getting quotas for user b8158ebeedf7438b9e3306186c1898cd and project 4bb5a1e0698348739f44376f82c933ad. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:27:30.186726 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-65e7e79b-77a1-42f9-88a4-7e250a1ea524 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Going to run 1 instances... {{(pid=117875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:27:30.188866 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-65e7e79b-77a1-42f9-88a4-7e250a1ea524 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1e0d5661-9d4d-42e5-a328-5a03707743d8',volume_size=None,volume_type=None)] {{(pid=117875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:27:30.341404 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-65e7e79b-77a1-42f9-88a4-7e250a1ea524 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.910476 Jul 04 04:27:30.342046 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 566/1103] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:27:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 04:27:30.350025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:30.351546 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:30.356488 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-afc382ab-9c14-4383-863f-9937c8eab652 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:30.357104 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-afc382ab-9c14-4383-863f-9937c8eab652 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:30.425844 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-afc382ab-9c14-4383-863f-9937c8eab652 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:30.432786 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-afc382ab-9c14-4383-863f-9937c8eab652 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1088 microversion: 2.1 time: 0.084517 Jul 04 04:27:30.433499 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 538/1104] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:30 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1088 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:27:31.453045 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-4fc34116-5161-4c2e-8314-634f2bc64962 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:31.456958 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-4fc34116-5161-4c2e-8314-634f2bc64962 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:31.466349 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4fc34116-5161-4c2e-8314-634f2bc64962 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:31.466873 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4fc34116-5161-4c2e-8314-634f2bc64962 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:31.467654 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4fc34116-5161-4c2e-8314-634f2bc64962 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:31.468240 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-4fc34116-5161-4c2e-8314-634f2bc64962 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:31.544684 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-4fc34116-5161-4c2e-8314-634f2bc64962 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:31.552815 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-4fc34116-5161-4c2e-8314-634f2bc64962 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1204 microversion: 2.1 time: 0.106500 Jul 04 04:27:31.554220 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 567/1105] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:31 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1204 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:27:32.572444 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-09b9428f-3941-4b9c-97b4-9b8447f9ab4f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:32.573109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-09b9428f-3941-4b9c-97b4-9b8447f9ab4f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:32.581267 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-09b9428f-3941-4b9c-97b4-9b8447f9ab4f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:32.581726 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-09b9428f-3941-4b9c-97b4-9b8447f9ab4f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:32.582606 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-09b9428f-3941-4b9c-97b4-9b8447f9ab4f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:32.583043 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-09b9428f-3941-4b9c-97b4-9b8447f9ab4f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:32.855484 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-09b9428f-3941-4b9c-97b4-9b8447f9ab4f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:32.863501 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-09b9428f-3941-4b9c-97b4-9b8447f9ab4f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1259 microversion: 2.1 time: 0.295499 Jul 04 04:27:32.864429 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 539/1106] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:32 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1259 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:27:33.016663 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-76ef3b0e-7adc-458b-bd5c-97a6a69bba4e req-fbaaee11-f50b-47b8-85cd-6da7067bc709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0877b0b-09e7-4cfc-87a7-7c95da81096c", "tag": "bdb14aee-0130-4a98-a8dd-8200f34b2261"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:27:33.039766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-76ef3b0e-7adc-458b-bd5c-97a6a69bba4e req-fbaaee11-f50b-47b8-85cd-6da7067bc709 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:33.047660 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-76ef3b0e-7adc-458b-bd5c-97a6a69bba4e req-fbaaee11-f50b-47b8-85cd-6da7067bc709 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:33.063400 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-76ef3b0e-7adc-458b-bd5c-97a6a69bba4e req-fbaaee11-f50b-47b8-85cd-6da7067bc709 service nova] Creating event network-changed:bdb14aee-0130-4a98-a8dd-8200f34b2261 for instance f0877b0b-09e7-4cfc-87a7-7c95da81096c on hv-cinder-74216 Jul 04 04:27:33.069028 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-76ef3b0e-7adc-458b-bd5c-97a6a69bba4e req-fbaaee11-f50b-47b8-85cd-6da7067bc709 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056277 Jul 04 04:27:33.069919 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 568/1107] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:27:33.885680 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2a6f6f1d-edbd-410b-bfdf-f3763b7fc090 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:33.886506 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2a6f6f1d-edbd-410b-bfdf-f3763b7fc090 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:33.893715 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a6f6f1d-edbd-410b-bfdf-f3763b7fc090 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:33.894163 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a6f6f1d-edbd-410b-bfdf-f3763b7fc090 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:33.894961 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a6f6f1d-edbd-410b-bfdf-f3763b7fc090 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:33.895386 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a6f6f1d-edbd-410b-bfdf-f3763b7fc090 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:34.031965 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2a6f6f1d-edbd-410b-bfdf-f3763b7fc090 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:34.043216 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2a6f6f1d-edbd-410b-bfdf-f3763b7fc090 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1259 microversion: 2.1 time: 0.163740 Jul 04 04:27:34.043818 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 540/1108] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:33 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:27:35.064837 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b87479d5-87f4-41b5-a8f1-14ad766b9620 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:35.065543 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b87479d5-87f4-41b5-a8f1-14ad766b9620 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:35.072587 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b87479d5-87f4-41b5-a8f1-14ad766b9620 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:35.073126 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b87479d5-87f4-41b5-a8f1-14ad766b9620 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:35.073936 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b87479d5-87f4-41b5-a8f1-14ad766b9620 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:35.074352 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b87479d5-87f4-41b5-a8f1-14ad766b9620 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:35.225209 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b87479d5-87f4-41b5-a8f1-14ad766b9620 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:35.233553 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b87479d5-87f4-41b5-a8f1-14ad766b9620 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1259 microversion: 2.1 time: 0.173619 Jul 04 04:27:35.234145 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 569/1109] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:35 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:27:36.250881 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bea94534-27e3-4bd9-90f3-4bf811bdaadc tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:36.251510 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bea94534-27e3-4bd9-90f3-4bf811bdaadc tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:36.259014 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bea94534-27e3-4bd9-90f3-4bf811bdaadc tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:36.259462 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bea94534-27e3-4bd9-90f3-4bf811bdaadc tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:36.260239 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bea94534-27e3-4bd9-90f3-4bf811bdaadc tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:36.260666 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bea94534-27e3-4bd9-90f3-4bf811bdaadc tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:36.408445 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bea94534-27e3-4bd9-90f3-4bf811bdaadc tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:36.416364 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bea94534-27e3-4bd9-90f3-4bf811bdaadc tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1259 microversion: 2.1 time: 0.169473 Jul 04 04:27:36.416939 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 541/1110] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:36 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:27:37.433078 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-dd724f2e-25e0-4064-8faa-632bf2cc42b8 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:37.433713 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-dd724f2e-25e0-4064-8faa-632bf2cc42b8 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:37.440672 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dd724f2e-25e0-4064-8faa-632bf2cc42b8 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:37.441119 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dd724f2e-25e0-4064-8faa-632bf2cc42b8 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:37.441881 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dd724f2e-25e0-4064-8faa-632bf2cc42b8 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:37.442315 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-dd724f2e-25e0-4064-8faa-632bf2cc42b8 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:37.601654 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-dd724f2e-25e0-4064-8faa-632bf2cc42b8 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:37.609490 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-dd724f2e-25e0-4064-8faa-632bf2cc42b8 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1259 microversion: 2.1 time: 0.180375 Jul 04 04:27:37.612621 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 570/1111] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:37 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:27:38.630471 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bfd9d122-c9dc-4a60-882b-6b417e7c0cd1 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:38.631563 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bfd9d122-c9dc-4a60-882b-6b417e7c0cd1 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:38.642944 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfd9d122-c9dc-4a60-882b-6b417e7c0cd1 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:38.644454 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfd9d122-c9dc-4a60-882b-6b417e7c0cd1 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:38.644908 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfd9d122-c9dc-4a60-882b-6b417e7c0cd1 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:38.645622 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bfd9d122-c9dc-4a60-882b-6b417e7c0cd1 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:38.790633 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bfd9d122-c9dc-4a60-882b-6b417e7c0cd1 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:38.798536 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bfd9d122-c9dc-4a60-882b-6b417e7c0cd1 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1259 microversion: 2.1 time: 0.174625 Jul 04 04:27:38.799060 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 542/1112] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:38 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:27:39.815335 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-8d58b378-4795-4e73-a7fc-7b059c4a2eb0 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:39.815956 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-8d58b378-4795-4e73-a7fc-7b059c4a2eb0 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:39.822816 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8d58b378-4795-4e73-a7fc-7b059c4a2eb0 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:39.823267 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8d58b378-4795-4e73-a7fc-7b059c4a2eb0 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:39.824028 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8d58b378-4795-4e73-a7fc-7b059c4a2eb0 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:39.824449 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8d58b378-4795-4e73-a7fc-7b059c4a2eb0 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:39.978049 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-8d58b378-4795-4e73-a7fc-7b059c4a2eb0 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:39.986404 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-8d58b378-4795-4e73-a7fc-7b059c4a2eb0 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1259 microversion: 2.1 time: 0.174989 Jul 04 04:27:39.987009 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 571/1113] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:39 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:27:41.005147 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a3aacb60-250a-44cd-a652-9e154afe1919 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:41.005757 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a3aacb60-250a-44cd-a652-9e154afe1919 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:41.008179 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:41.014931 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3aacb60-250a-44cd-a652-9e154afe1919 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:41.015374 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3aacb60-250a-44cd-a652-9e154afe1919 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:41.016142 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3aacb60-250a-44cd-a652-9e154afe1919 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:41.016603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3aacb60-250a-44cd-a652-9e154afe1919 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:41.163383 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a3aacb60-250a-44cd-a652-9e154afe1919 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:41.171274 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a3aacb60-250a-44cd-a652-9e154afe1919 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1259 microversion: 2.1 time: 0.170364 Jul 04 04:27:41.171855 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 543/1114] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:40 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:27:42.188961 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-17a79045-0f7e-46cf-ac1c-5044b22dd938 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:42.189555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-17a79045-0f7e-46cf-ac1c-5044b22dd938 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:42.191559 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=2 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:42.192211 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=6 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:42.199054 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-17a79045-0f7e-46cf-ac1c-5044b22dd938 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:42.199514 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-17a79045-0f7e-46cf-ac1c-5044b22dd938 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:42.200271 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-17a79045-0f7e-46cf-ac1c-5044b22dd938 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:42.200725 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-17a79045-0f7e-46cf-ac1c-5044b22dd938 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:42.350948 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-17a79045-0f7e-46cf-ac1c-5044b22dd938 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:42.359004 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-17a79045-0f7e-46cf-ac1c-5044b22dd938 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1259 microversion: 2.1 time: 0.173941 Jul 04 04:27:42.359626 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 572/1115] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:42 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:27:43.379205 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e6346d64-ae0b-4ef9-a81b-1b74a43d947d tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:43.379773 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e6346d64-ae0b-4ef9-a81b-1b74a43d947d tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:43.387195 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6346d64-ae0b-4ef9-a81b-1b74a43d947d tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:43.387640 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6346d64-ae0b-4ef9-a81b-1b74a43d947d tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:43.388407 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6346d64-ae0b-4ef9-a81b-1b74a43d947d tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:43.388836 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e6346d64-ae0b-4ef9-a81b-1b74a43d947d tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:43.530114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e6346d64-ae0b-4ef9-a81b-1b74a43d947d tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:43.538846 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e6346d64-ae0b-4ef9-a81b-1b74a43d947d tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1259 microversion: 2.1 time: 0.164332 Jul 04 04:27:43.539415 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 544/1116] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:43 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:27:44.475876 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-91d73d13-3e00-4df0-bfcb-eee8c87de274 req-af5fb271-6609-44f9-ad25-98d0488a2f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0877b0b-09e7-4cfc-87a7-7c95da81096c", "name": "network-vif-plugged", "status": "completed", "tag": "bdb14aee-0130-4a98-a8dd-8200f34b2261"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:27:44.486577 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-91d73d13-3e00-4df0-bfcb-eee8c87de274 req-af5fb271-6609-44f9-ad25-98d0488a2f49 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:44.487249 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-91d73d13-3e00-4df0-bfcb-eee8c87de274 req-af5fb271-6609-44f9-ad25-98d0488a2f49 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:44.498784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-91d73d13-3e00-4df0-bfcb-eee8c87de274 req-af5fb271-6609-44f9-ad25-98d0488a2f49 service nova] Creating event network-vif-plugged:bdb14aee-0130-4a98-a8dd-8200f34b2261 for instance f0877b0b-09e7-4cfc-87a7-7c95da81096c on hv-cinder-74216 Jul 04 04:27:44.504342 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-91d73d13-3e00-4df0-bfcb-eee8c87de274 req-af5fb271-6609-44f9-ad25-98d0488a2f49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032043 Jul 04 04:27:44.505133 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 573/1117] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:27:44.556298 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0db9345c-8987-4248-b32c-9c8fd5b0a8a0 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:44.556886 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0db9345c-8987-4248-b32c-9c8fd5b0a8a0 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:44.564099 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0db9345c-8987-4248-b32c-9c8fd5b0a8a0 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:44.564547 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0db9345c-8987-4248-b32c-9c8fd5b0a8a0 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:44.565348 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0db9345c-8987-4248-b32c-9c8fd5b0a8a0 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:44.565765 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0db9345c-8987-4248-b32c-9c8fd5b0a8a0 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:44.709299 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0db9345c-8987-4248-b32c-9c8fd5b0a8a0 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:44.718210 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0db9345c-8987-4248-b32c-9c8fd5b0a8a0 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1259 microversion: 2.1 time: 0.166207 Jul 04 04:27:44.718823 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 545/1118] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:44 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:27:45.741282 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d12847a8-d016-4dae-a289-8ed1d5662077 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:45.742426 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d12847a8-d016-4dae-a289-8ed1d5662077 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:45.752846 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d12847a8-d016-4dae-a289-8ed1d5662077 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:45.753167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d12847a8-d016-4dae-a289-8ed1d5662077 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:45.753930 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d12847a8-d016-4dae-a289-8ed1d5662077 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:45.754359 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d12847a8-d016-4dae-a289-8ed1d5662077 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:45.894009 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d12847a8-d016-4dae-a289-8ed1d5662077 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:45.901988 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d12847a8-d016-4dae-a289-8ed1d5662077 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1259 microversion: 2.1 time: 0.168963 Jul 04 04:27:45.902639 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 574/1119] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:45 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:27:46.924365 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5c27590f-3ede-47f3-9367-b4307c8ca28f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:46.925820 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5c27590f-3ede-47f3-9367-b4307c8ca28f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:46.936823 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c27590f-3ede-47f3-9367-b4307c8ca28f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:46.937523 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c27590f-3ede-47f3-9367-b4307c8ca28f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:46.938880 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c27590f-3ede-47f3-9367-b4307c8ca28f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:46.939602 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c27590f-3ede-47f3-9367-b4307c8ca28f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:47.119090 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5c27590f-3ede-47f3-9367-b4307c8ca28f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:47.128919 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5c27590f-3ede-47f3-9367-b4307c8ca28f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1259 microversion: 2.1 time: 0.210981 Jul 04 04:27:47.129585 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 546/1120] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:46 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:27:48.148732 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-ba6dd908-77cd-4241-a8af-76528b201237 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:48.149368 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-ba6dd908-77cd-4241-a8af-76528b201237 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:48.156462 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ba6dd908-77cd-4241-a8af-76528b201237 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:48.156906 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ba6dd908-77cd-4241-a8af-76528b201237 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:48.157812 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ba6dd908-77cd-4241-a8af-76528b201237 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:48.158244 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-ba6dd908-77cd-4241-a8af-76528b201237 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:48.297549 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-ba6dd908-77cd-4241-a8af-76528b201237 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:48.305470 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-ba6dd908-77cd-4241-a8af-76528b201237 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1443 microversion: 2.1 time: 0.161001 Jul 04 04:27:48.306022 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 575/1121] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:48 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:27:48.321777 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7a1d379b-7eb2-49ea-be87-f192b8935d2b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:27:48.322353 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7a1d379b-7eb2-49ea-be87-f192b8935d2b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:27:48.329236 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a1d379b-7eb2-49ea-be87-f192b8935d2b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:48.329674 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a1d379b-7eb2-49ea-be87-f192b8935d2b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:48.330435 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a1d379b-7eb2-49ea-be87-f192b8935d2b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:48.330896 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a1d379b-7eb2-49ea-be87-f192b8935d2b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:48.486612 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7a1d379b-7eb2-49ea-be87-f192b8935d2b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:27:48.497965 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7a1d379b-7eb2-49ea-be87-f192b8935d2b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1443 microversion: 2.1 time: 0.179742 Jul 04 04:27:48.498723 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 547/1122] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:27:48 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1443 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:27:50.579682 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-33b0a4c1-dea8-4c21-85be-30a3154639d4 req-bf202082-ee00-4b2e-959d-c7211d507748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0877b0b-09e7-4cfc-87a7-7c95da81096c", "tag": "bdb14aee-0130-4a98-a8dd-8200f34b2261"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:27:50.589923 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-33b0a4c1-dea8-4c21-85be-30a3154639d4 req-bf202082-ee00-4b2e-959d-c7211d507748 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:27:50.590479 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-33b0a4c1-dea8-4c21-85be-30a3154639d4 req-bf202082-ee00-4b2e-959d-c7211d507748 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:27:50.603124 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-33b0a4c1-dea8-4c21-85be-30a3154639d4 req-bf202082-ee00-4b2e-959d-c7211d507748 service nova] Creating event network-changed:bdb14aee-0130-4a98-a8dd-8200f34b2261 for instance f0877b0b-09e7-4cfc-87a7-7c95da81096c on hv-cinder-74216 Jul 04 04:27:50.609442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-33b0a4c1-dea8-4c21-85be-30a3154639d4 req-bf202082-ee00-4b2e-959d-c7211d507748 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033618 Jul 04 04:27:50.610693 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 576/1123] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:28:17.220275 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-446e7a2b-e55e-43a3-9aa8-92385ef7fd0b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1585723493", "imageRef": "46b9937d-f997-401a-a3aa-bb9028764454", "flavorRef": "452", "networks": [{"uuid": "ea2047cf-f0f5-4c3d-b4c0-929a4b72175b"}]}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:28:17.227118 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=22 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:28:17.227771 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=54 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:28:17.283426 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-446e7a2b-e55e-43a3-9aa8-92385ef7fd0b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] validate_networks() for [('ea2047cf-f0f5-4c3d-b4c0-929a4b72175b', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:28:17.654158 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-446e7a2b-e55e-43a3-9aa8-92385ef7fd0b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:28:17.654682 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-446e7a2b-e55e-43a3-9aa8-92385ef7fd0b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:28:17.655152 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-446e7a2b-e55e-43a3-9aa8-92385ef7fd0b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:28:17.655559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-446e7a2b-e55e-43a3-9aa8-92385ef7fd0b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:28:17.656035 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-446e7a2b-e55e-43a3-9aa8-92385ef7fd0b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:28:17.665648 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-446e7a2b-e55e-43a3-9aa8-92385ef7fd0b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:17.666090 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-446e7a2b-e55e-43a3-9aa8-92385ef7fd0b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:17.666919 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-446e7a2b-e55e-43a3-9aa8-92385ef7fd0b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:17.667353 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-446e7a2b-e55e-43a3-9aa8-92385ef7fd0b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:17.684943 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-446e7a2b-e55e-43a3-9aa8-92385ef7fd0b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Getting quotas for project 5cfc2721cf3146beb4471ded02b1b637. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:28:17.688917 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-446e7a2b-e55e-43a3-9aa8-92385ef7fd0b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Getting quotas for user 4e12c4cfe11c4be58991df7173e4533f and project 5cfc2721cf3146beb4471ded02b1b637. Resources: {'cores', 'instances', 'ram'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:28:17.700965 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-446e7a2b-e55e-43a3-9aa8-92385ef7fd0b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:28:17.703235 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-446e7a2b-e55e-43a3-9aa8-92385ef7fd0b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46b9937d-f997-401a-a3aa-bb9028764454',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:28:17.750749 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-446e7a2b-e55e-43a3-9aa8-92385ef7fd0b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534196 Jul 04 04:28:17.751507 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 548/1124] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:28:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 04:28:17.761460 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:28:17.762484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=50 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:28:17.766553 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-dc7e0b20-5e60-4710-945b-93b2de33e1ee tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:28:17.767242 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-dc7e0b20-5e60-4710-945b-93b2de33e1ee tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:28:17.824255 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-dc7e0b20-5e60-4710-945b-93b2de33e1ee tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:28:17.831136 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-dc7e0b20-5e60-4710-945b-93b2de33e1ee tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127" status: 200 len: 1219 microversion: 2.1 time: 0.072675 Jul 04 04:28:17.831698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 577/1125] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:28:17 2022] GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:28:18.849073 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d4bf3d3b-f5b3-4a99-b416-80d79b23c20f tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:28:18.849783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d4bf3d3b-f5b3-4a99-b416-80d79b23c20f tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:28:18.857704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4bf3d3b-f5b3-4a99-b416-80d79b23c20f tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:18.858495 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4bf3d3b-f5b3-4a99-b416-80d79b23c20f tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:18.859272 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4bf3d3b-f5b3-4a99-b416-80d79b23c20f tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:18.859859 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4bf3d3b-f5b3-4a99-b416-80d79b23c20f tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:18.952966 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d4bf3d3b-f5b3-4a99-b416-80d79b23c20f tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:28:18.961349 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d4bf3d3b-f5b3-4a99-b416-80d79b23c20f tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127" status: 200 len: 1279 microversion: 2.1 time: 0.116807 Jul 04 04:28:18.961931 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 549/1126] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:28:18 2022] GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127 => generated 1279 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:28:19.984197 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1c1e9795-eb04-4d06-8307-c52f34e093eb tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:28:19.984821 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-1c1e9795-eb04-4d06-8307-c52f34e093eb tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:28:19.992483 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1c1e9795-eb04-4d06-8307-c52f34e093eb tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:19.992941 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1c1e9795-eb04-4d06-8307-c52f34e093eb tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:19.993759 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1c1e9795-eb04-4d06-8307-c52f34e093eb tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:19.994189 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1c1e9795-eb04-4d06-8307-c52f34e093eb tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:20.128943 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-1c1e9795-eb04-4d06-8307-c52f34e093eb tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:28:20.137218 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-1c1e9795-eb04-4d06-8307-c52f34e093eb tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127" status: 200 len: 1319 microversion: 2.1 time: 0.156970 Jul 04 04:28:20.137960 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 578/1127] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:28:19 2022] GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:28:20.253990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-79fd39b4-141d-46f6-b3bf-afa63e8aee0d req-2ce75eda-36a2-4afb-a70e-0aadda4aa993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d7a844-bd93-4a53-9c7d-b05eb08d0127", "tag": "6551ebc5-7d05-4db4-b4ea-83a4ac8aa497"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:28:20.263549 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-79fd39b4-141d-46f6-b3bf-afa63e8aee0d req-2ce75eda-36a2-4afb-a70e-0aadda4aa993 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:20.264174 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-79fd39b4-141d-46f6-b3bf-afa63e8aee0d req-2ce75eda-36a2-4afb-a70e-0aadda4aa993 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:20.282225 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-79fd39b4-141d-46f6-b3bf-afa63e8aee0d req-2ce75eda-36a2-4afb-a70e-0aadda4aa993 service nova] Creating event network-changed:6551ebc5-7d05-4db4-b4ea-83a4ac8aa497 for instance 22d7a844-bd93-4a53-9c7d-b05eb08d0127 on hv-cinder-74216 Jul 04 04:28:20.288711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-79fd39b4-141d-46f6-b3bf-afa63e8aee0d req-2ce75eda-36a2-4afb-a70e-0aadda4aa993 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038131 Jul 04 04:28:20.289764 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 550/1128] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:28:21.154787 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-94e901ff-68d2-403c-b1df-64683d1115a5 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:28:21.155560 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-94e901ff-68d2-403c-b1df-64683d1115a5 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:28:21.162647 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-94e901ff-68d2-403c-b1df-64683d1115a5 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:21.163212 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-94e901ff-68d2-403c-b1df-64683d1115a5 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:21.164227 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-94e901ff-68d2-403c-b1df-64683d1115a5 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:21.164673 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-94e901ff-68d2-403c-b1df-64683d1115a5 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:21.297728 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-94e901ff-68d2-403c-b1df-64683d1115a5 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:28:21.305522 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-94e901ff-68d2-403c-b1df-64683d1115a5 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127" status: 200 len: 1319 microversion: 2.1 time: 0.155507 Jul 04 04:28:21.306089 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 579/1129] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:28:21 2022] GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:28:22.332733 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-36a92f9c-bc67-4728-99b8-7254dd4e29d0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:28:22.333875 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-36a92f9c-bc67-4728-99b8-7254dd4e29d0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:28:22.344988 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36a92f9c-bc67-4728-99b8-7254dd4e29d0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:22.345720 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36a92f9c-bc67-4728-99b8-7254dd4e29d0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:22.347052 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36a92f9c-bc67-4728-99b8-7254dd4e29d0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:22.347761 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36a92f9c-bc67-4728-99b8-7254dd4e29d0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:22.480583 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-36a92f9c-bc67-4728-99b8-7254dd4e29d0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:28:22.491942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-36a92f9c-bc67-4728-99b8-7254dd4e29d0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127" status: 200 len: 1319 microversion: 2.1 time: 0.165591 Jul 04 04:28:22.492552 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 551/1130] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:28:22 2022] GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:28:23.512936 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c628c06c-67bb-4e6c-8088-3f2ad6a78257 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:28:23.514070 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c628c06c-67bb-4e6c-8088-3f2ad6a78257 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:28:23.523541 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c628c06c-67bb-4e6c-8088-3f2ad6a78257 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:23.523980 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c628c06c-67bb-4e6c-8088-3f2ad6a78257 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:23.524743 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c628c06c-67bb-4e6c-8088-3f2ad6a78257 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:23.525167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c628c06c-67bb-4e6c-8088-3f2ad6a78257 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:23.669105 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c628c06c-67bb-4e6c-8088-3f2ad6a78257 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:28:23.682439 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c628c06c-67bb-4e6c-8088-3f2ad6a78257 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127" status: 200 len: 1319 microversion: 2.1 time: 0.176602 Jul 04 04:28:23.683256 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 580/1131] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:28:23 2022] GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:28:24.700026 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-968ac848-42cb-479d-b3fd-ec386510de01 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:28:24.700666 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-968ac848-42cb-479d-b3fd-ec386510de01 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:28:24.707550 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-968ac848-42cb-479d-b3fd-ec386510de01 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:24.707994 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-968ac848-42cb-479d-b3fd-ec386510de01 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:24.708767 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-968ac848-42cb-479d-b3fd-ec386510de01 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:24.709198 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-968ac848-42cb-479d-b3fd-ec386510de01 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:24.837608 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-968ac848-42cb-479d-b3fd-ec386510de01 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:28:24.845471 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-968ac848-42cb-479d-b3fd-ec386510de01 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127" status: 200 len: 1319 microversion: 2.1 time: 0.149420 Jul 04 04:28:24.846042 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 552/1132] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:28:24 2022] GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:28:25.866925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-22ee893a-9e8f-4b08-bce8-555907e5d8a5 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:28:25.867974 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-22ee893a-9e8f-4b08-bce8-555907e5d8a5 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:28:25.879104 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-22ee893a-9e8f-4b08-bce8-555907e5d8a5 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:25.879839 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-22ee893a-9e8f-4b08-bce8-555907e5d8a5 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:25.881092 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-22ee893a-9e8f-4b08-bce8-555907e5d8a5 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:25.881810 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-22ee893a-9e8f-4b08-bce8-555907e5d8a5 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:26.021493 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-22ee893a-9e8f-4b08-bce8-555907e5d8a5 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:28:26.030757 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-22ee893a-9e8f-4b08-bce8-555907e5d8a5 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127" status: 200 len: 1319 microversion: 2.1 time: 0.170519 Jul 04 04:28:26.031319 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 581/1133] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:28:25 2022] GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:28:26.623335 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-2e92ed45-f752-44ca-b602-939ff5852584 req-900289c4-02ce-421e-89bb-4d0dfc58d121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d7a844-bd93-4a53-9c7d-b05eb08d0127", "name": "network-vif-plugged", "status": "completed", "tag": "6551ebc5-7d05-4db4-b4ea-83a4ac8aa497"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:28:26.632686 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-2e92ed45-f752-44ca-b602-939ff5852584 req-900289c4-02ce-421e-89bb-4d0dfc58d121 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:26.633502 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-2e92ed45-f752-44ca-b602-939ff5852584 req-900289c4-02ce-421e-89bb-4d0dfc58d121 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:26.645340 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-2e92ed45-f752-44ca-b602-939ff5852584 req-900289c4-02ce-421e-89bb-4d0dfc58d121 service nova] Creating event network-vif-plugged:6551ebc5-7d05-4db4-b4ea-83a4ac8aa497 for instance 22d7a844-bd93-4a53-9c7d-b05eb08d0127 on hv-cinder-74216 Jul 04 04:28:26.650735 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-2e92ed45-f752-44ca-b602-939ff5852584 req-900289c4-02ce-421e-89bb-4d0dfc58d121 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031269 Jul 04 04:28:26.651423 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 553/1134] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:28:27.047915 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e1d24a45-780e-4e89-b363-2ad65cdc01ce tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:28:27.048523 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e1d24a45-780e-4e89-b363-2ad65cdc01ce tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:28:27.055586 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e1d24a45-780e-4e89-b363-2ad65cdc01ce tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:27.056037 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e1d24a45-780e-4e89-b363-2ad65cdc01ce tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:27.056806 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e1d24a45-780e-4e89-b363-2ad65cdc01ce tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:27.057234 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e1d24a45-780e-4e89-b363-2ad65cdc01ce tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:27.198239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e1d24a45-780e-4e89-b363-2ad65cdc01ce tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:28:27.206279 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e1d24a45-780e-4e89-b363-2ad65cdc01ce tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127" status: 200 len: 1319 microversion: 2.1 time: 0.162386 Jul 04 04:28:27.206893 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 582/1135] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:28:27 2022] GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:28:28.224125 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:28:28.225016 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=6 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:28:28.229667 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aa73dc1e-e311-4065-8803-2ea09491f1db tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:28:28.230490 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aa73dc1e-e311-4065-8803-2ea09491f1db tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:28:28.238248 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa73dc1e-e311-4065-8803-2ea09491f1db tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:28.238743 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa73dc1e-e311-4065-8803-2ea09491f1db tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:28.239555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa73dc1e-e311-4065-8803-2ea09491f1db tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:28.240011 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa73dc1e-e311-4065-8803-2ea09491f1db tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:28.377054 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aa73dc1e-e311-4065-8803-2ea09491f1db tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:28:28.385243 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aa73dc1e-e311-4065-8803-2ea09491f1db tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127" status: 200 len: 1319 microversion: 2.1 time: 0.162629 Jul 04 04:28:28.385784 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 554/1136] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:28:28 2022] GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:28:29.404468 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e42c4a95-4d42-4217-b6e0-3038625e3472 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:28:29.405190 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e42c4a95-4d42-4217-b6e0-3038625e3472 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:28:29.407535 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=2 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:28:29.415070 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e42c4a95-4d42-4217-b6e0-3038625e3472 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:29.415637 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e42c4a95-4d42-4217-b6e0-3038625e3472 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:29.416604 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e42c4a95-4d42-4217-b6e0-3038625e3472 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:29.417140 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e42c4a95-4d42-4217-b6e0-3038625e3472 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:29.554047 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e42c4a95-4d42-4217-b6e0-3038625e3472 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:28:29.562019 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e42c4a95-4d42-4217-b6e0-3038625e3472 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127" status: 200 len: 1509 microversion: 2.1 time: 0.162428 Jul 04 04:28:29.562604 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 583/1137] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:28:29 2022] GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:28:41.139365 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-83758ca3-bfa8-4e95-8db7-8a3e8e878f85 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:28:41.139365 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-83758ca3-bfa8-4e95-8db7-8a3e8e878f85 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:28:41.145941 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:28:41.147367 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=30 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:28:41.148273 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83758ca3-bfa8-4e95-8db7-8a3e8e878f85 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:41.149115 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83758ca3-bfa8-4e95-8db7-8a3e8e878f85 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:41.149903 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83758ca3-bfa8-4e95-8db7-8a3e8e878f85 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:41.150521 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83758ca3-bfa8-4e95-8db7-8a3e8e878f85 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:41.178522 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-83758ca3-bfa8-4e95-8db7-8a3e8e878f85 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/ips" status: 200 len: 146 microversion: 2.1 time: 0.043811 Jul 04 04:28:41.179091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 555/1138] 10.222.0.16 () {58 vars in 1247 bytes} [Mon Jul 4 04:28:41 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:28:42.525602 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-687f551c-8a4d-4e61-bf31-4c3a46385f22 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f871ded5-12c1-41b8-9cf2-cbdfc65488c4"}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:28:42.527024 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-687f551c-8a4d-4e61-bf31-4c3a46385f22 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:28:42.530753 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=16 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:28:42.531554 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=36 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:28:42.538226 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-687f551c-8a4d-4e61-bf31-4c3a46385f22 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:42.538707 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-687f551c-8a4d-4e61-bf31-4c3a46385f22 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:42.539507 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-687f551c-8a4d-4e61-bf31-4c3a46385f22 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:42.539939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-687f551c-8a4d-4e61-bf31-4c3a46385f22 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:42.824053 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-687f551c-8a4d-4e61-bf31-4c3a46385f22 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "POST /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304790 Jul 04 04:28:42.824736 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 584/1139] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jul 4 04:28:42 2022] POST /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:28:50.355249 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b4ec9cb9-2f69-4cc4-b2ac-6ca9e2a8d29d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:28:50.356496 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b4ec9cb9-2f69-4cc4-b2ac-6ca9e2a8d29d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:28:50.366709 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b4ec9cb9-2f69-4cc4-b2ac-6ca9e2a8d29d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:50.367199 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b4ec9cb9-2f69-4cc4-b2ac-6ca9e2a8d29d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:50.367971 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b4ec9cb9-2f69-4cc4-b2ac-6ca9e2a8d29d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:50.368413 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b4ec9cb9-2f69-4cc4-b2ac-6ca9e2a8d29d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:50.399122 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b4ec9cb9-2f69-4cc4-b2ac-6ca9e2a8d29d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051303 Jul 04 04:28:50.399688 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 556/1140] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:28:50 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:28:50.410852 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-0ce09405-abed-4660-951f-ab42f8ba1c4e tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:28:50.412059 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-0ce09405-abed-4660-951f-ab42f8ba1c4e tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:28:50.418921 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0ce09405-abed-4660-951f-ab42f8ba1c4e tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:50.419365 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0ce09405-abed-4660-951f-ab42f8ba1c4e tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:50.420135 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0ce09405-abed-4660-951f-ab42f8ba1c4e tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:50.420562 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0ce09405-abed-4660-951f-ab42f8ba1c4e tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:50.449651 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-0ce09405-abed-4660-951f-ab42f8ba1c4e tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments/f871ded5-12c1-41b8-9cf2-cbdfc65488c4" status: 200 len: 194 microversion: 2.1 time: 0.043605 Jul 04 04:28:50.450239 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 585/1141] 10.222.0.16 () {58 vars in 1412 bytes} [Mon Jul 4 04:28:50 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments/f871ded5-12c1-41b8-9cf2-cbdfc65488c4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:28:52.865333 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-24fe1c4f-db2a-4b44-8e0e-78f96060e39f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24637846-707c-4b33-a727-f5fb4506d1a6"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:28:52.867485 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-24fe1c4f-db2a-4b44-8e0e-78f96060e39f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:28:52.878047 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24fe1c4f-db2a-4b44-8e0e-78f96060e39f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:52.878724 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24fe1c4f-db2a-4b44-8e0e-78f96060e39f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:52.879842 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24fe1c4f-db2a-4b44-8e0e-78f96060e39f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:52.880525 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-24fe1c4f-db2a-4b44-8e0e-78f96060e39f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:53.161980 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-24fe1c4f-db2a-4b44-8e0e-78f96060e39f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "POST /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303199 Jul 04 04:28:53.162711 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 557/1142] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jul 4 04:28:52 2022] POST /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:28:53.268806 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-72b82af2-f846-471f-9d5c-87fd977986ed tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61f71570-b09f-4ad8-a147-0bea2ebae7ad", "device": "/dev/sdb"}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:28:53.270489 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-72b82af2-f846-471f-9d5c-87fd977986ed tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:28:53.277373 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-72b82af2-f846-471f-9d5c-87fd977986ed tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:53.277841 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-72b82af2-f846-471f-9d5c-87fd977986ed tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:53.278626 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-72b82af2-f846-471f-9d5c-87fd977986ed tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:28:53.279060 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-72b82af2-f846-471f-9d5c-87fd977986ed tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:28:53.554710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-72b82af2-f846-471f-9d5c-87fd977986ed tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "POST /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289821 Jul 04 04:28:53.555692 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 586/1143] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jul 4 04:28:53 2022] POST /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:29:00.734846 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-634c6e50-7ad3-4c8a-b980-e0ccce4f8c0b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:00.735869 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-634c6e50-7ad3-4c8a-b980-e0ccce4f8c0b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:00.742446 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-634c6e50-7ad3-4c8a-b980-e0ccce4f8c0b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:00.742910 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-634c6e50-7ad3-4c8a-b980-e0ccce4f8c0b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:00.743695 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-634c6e50-7ad3-4c8a-b980-e0ccce4f8c0b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:00.744173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-634c6e50-7ad3-4c8a-b980-e0ccce4f8c0b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:00.776782 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-634c6e50-7ad3-4c8a-b980-e0ccce4f8c0b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046868 Jul 04 04:29:00.777344 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 558/1144] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:29:00 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:29:00.917870 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-65b1dcc3-1679-4b7b-983a-76458492536d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:00.918502 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-65b1dcc3-1679-4b7b-983a-76458492536d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:00.925601 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-65b1dcc3-1679-4b7b-983a-76458492536d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:00.926156 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-65b1dcc3-1679-4b7b-983a-76458492536d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:00.927059 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-65b1dcc3-1679-4b7b-983a-76458492536d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:00.927505 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-65b1dcc3-1679-4b7b-983a-76458492536d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:00.956699 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-65b1dcc3-1679-4b7b-983a-76458492536d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments/f871ded5-12c1-41b8-9cf2-cbdfc65488c4" status: 200 len: 194 microversion: 2.1 time: 0.043685 Jul 04 04:29:00.957282 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 587/1145] 10.222.0.16 () {58 vars in 1412 bytes} [Mon Jul 4 04:29:00 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments/f871ded5-12c1-41b8-9cf2-cbdfc65488c4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:29:00.969963 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-56c4d371-71f9-4a3b-bb52-05f3c0f27f9f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:00.970684 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-56c4d371-71f9-4a3b-bb52-05f3c0f27f9f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:00.980066 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56c4d371-71f9-4a3b-bb52-05f3c0f27f9f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:00.980530 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56c4d371-71f9-4a3b-bb52-05f3c0f27f9f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:00.981332 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56c4d371-71f9-4a3b-bb52-05f3c0f27f9f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:00.981742 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56c4d371-71f9-4a3b-bb52-05f3c0f27f9f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:01.068040 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-56c4d371-71f9-4a3b-bb52-05f3c0f27f9f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lazy-loading 'services' on Instance uuid 33838c72-5e62-4317-ab27-5e45d243c3ec {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:29:01.149732 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-56c4d371-71f9-4a3b-bb52-05f3c0f27f9f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "DELETE /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments/f871ded5-12c1-41b8-9cf2-cbdfc65488c4" status: 202 len: 0 microversion: 2.1 time: 0.185936 Jul 04 04:29:01.150402 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 559/1146] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jul 4 04:29:00 2022] DELETE /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments/f871ded5-12c1-41b8-9cf2-cbdfc65488c4 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:29:12.895012 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c89d9b19-3ad8-4533-ac00-cc8d4d5a11d2 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:12.895508 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c89d9b19-3ad8-4533-ac00-cc8d4d5a11d2 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:12.898181 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=8 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:29:12.898966 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:29:12.904825 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c89d9b19-3ad8-4533-ac00-cc8d4d5a11d2 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:12.905272 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c89d9b19-3ad8-4533-ac00-cc8d4d5a11d2 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:12.906056 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c89d9b19-3ad8-4533-ac00-cc8d4d5a11d2 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:12.906643 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c89d9b19-3ad8-4533-ac00-cc8d4d5a11d2 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:12.939117 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c89d9b19-3ad8-4533-ac00-cc8d4d5a11d2 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments/24637846-707c-4b33-a727-f5fb4506d1a6" status: 200 len: 194 microversion: 2.1 time: 0.059908 Jul 04 04:29:12.939838 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 588/1147] 10.222.0.16 () {58 vars in 1412 bytes} [Mon Jul 4 04:29:12 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments/24637846-707c-4b33-a727-f5fb4506d1a6 => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:29:12.947799 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=10 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:29:12.948559 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:29:12.953022 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-02f6acdc-6a5b-4cf1-accb-b2513611183b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:12.953603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-02f6acdc-6a5b-4cf1-accb-b2513611183b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:12.961477 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02f6acdc-6a5b-4cf1-accb-b2513611183b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:12.961925 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02f6acdc-6a5b-4cf1-accb-b2513611183b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:12.962723 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02f6acdc-6a5b-4cf1-accb-b2513611183b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:12.963329 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02f6acdc-6a5b-4cf1-accb-b2513611183b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:13.057679 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-02f6acdc-6a5b-4cf1-accb-b2513611183b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lazy-loading 'services' on Instance uuid 33838c72-5e62-4317-ab27-5e45d243c3ec {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:29:13.137687 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-02f6acdc-6a5b-4cf1-accb-b2513611183b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "DELETE /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments/24637846-707c-4b33-a727-f5fb4506d1a6" status: 202 len: 0 microversion: 2.1 time: 0.190861 Jul 04 04:29:13.138645 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 560/1148] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jul 4 04:29:12 2022] DELETE /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments/24637846-707c-4b33-a727-f5fb4506d1a6 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:29:18.563068 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-df80842b-c552-4825-8960-d74b59887cc1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:18.564057 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-df80842b-c552-4825-8960-d74b59887cc1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:18.571191 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-df80842b-c552-4825-8960-d74b59887cc1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:18.571639 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-df80842b-c552-4825-8960-d74b59887cc1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:18.572408 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-df80842b-c552-4825-8960-d74b59887cc1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:18.572843 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-df80842b-c552-4825-8960-d74b59887cc1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:18.601660 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-df80842b-c552-4825-8960-d74b59887cc1 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042631 Jul 04 04:29:18.602249 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 589/1149] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:29:18 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 04:29:18.735345 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-634a3bcd-b002-4b0c-a200-4e44147eb6bd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:18.736445 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-634a3bcd-b002-4b0c-a200-4e44147eb6bd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:18.743088 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-634a3bcd-b002-4b0c-a200-4e44147eb6bd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:18.743535 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-634a3bcd-b002-4b0c-a200-4e44147eb6bd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:18.744303 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-634a3bcd-b002-4b0c-a200-4e44147eb6bd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:18.744739 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-634a3bcd-b002-4b0c-a200-4e44147eb6bd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:18.774189 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-634a3bcd-b002-4b0c-a200-4e44147eb6bd tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043761 Jul 04 04:29:18.774851 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 561/1150] 10.222.0.16 () {58 vars in 1301 bytes} [Mon Jul 4 04:29:18 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 04:29:18.838076 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-2a134b6b-faff-4758-87b4-5ec657b9347c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:18.838614 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-2a134b6b-faff-4758-87b4-5ec657b9347c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:18.845038 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2a134b6b-faff-4758-87b4-5ec657b9347c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:18.845488 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2a134b6b-faff-4758-87b4-5ec657b9347c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:18.846250 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2a134b6b-faff-4758-87b4-5ec657b9347c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:18.846715 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-2a134b6b-faff-4758-87b4-5ec657b9347c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:18.871488 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-2a134b6b-faff-4758-87b4-5ec657b9347c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Going to try to terminate instance {{(pid=117875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:29:18.955127 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-2a134b6b-faff-4758-87b4-5ec657b9347c tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "DELETE /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 204 len: 0 microversion: 2.1 time: 0.120708 Jul 04 04:29:18.955794 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 590/1151] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:29:18 2022] DELETE /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:29:18.964630 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7271f7bb-a258-413e-aeb8-e9c9a8e54dfc tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:18.965247 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7271f7bb-a258-413e-aeb8-e9c9a8e54dfc tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:18.971477 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7271f7bb-a258-413e-aeb8-e9c9a8e54dfc tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:18.971860 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7271f7bb-a258-413e-aeb8-e9c9a8e54dfc tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:18.972635 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7271f7bb-a258-413e-aeb8-e9c9a8e54dfc tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:18.973076 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7271f7bb-a258-413e-aeb8-e9c9a8e54dfc tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:19.108890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7271f7bb-a258-413e-aeb8-e9c9a8e54dfc tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:19.117045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7271f7bb-a258-413e-aeb8-e9c9a8e54dfc tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1673 microversion: 2.1 time: 0.156549 Jul 04 04:29:19.117675 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 562/1152] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:18 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:20.141003 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a342920b-d8eb-4427-b8a1-e8abef7dab94 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:20.141705 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a342920b-d8eb-4427-b8a1-e8abef7dab94 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:20.149718 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a342920b-d8eb-4427-b8a1-e8abef7dab94 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:20.150200 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a342920b-d8eb-4427-b8a1-e8abef7dab94 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:20.151080 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a342920b-d8eb-4427-b8a1-e8abef7dab94 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:20.151541 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a342920b-d8eb-4427-b8a1-e8abef7dab94 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:20.309783 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-a342920b-d8eb-4427-b8a1-e8abef7dab94 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:20.321328 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a342920b-d8eb-4427-b8a1-e8abef7dab94 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1673 microversion: 2.1 time: 0.184849 Jul 04 04:29:20.322116 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 591/1153] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:20 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1673 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:21.344155 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a30b4dda-f866-4988-9e3c-37f7fa75297e tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:21.345212 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a30b4dda-f866-4988-9e3c-37f7fa75297e tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:21.356363 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a30b4dda-f866-4988-9e3c-37f7fa75297e tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:21.357124 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a30b4dda-f866-4988-9e3c-37f7fa75297e tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:21.358434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a30b4dda-f866-4988-9e3c-37f7fa75297e tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:21.359188 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a30b4dda-f866-4988-9e3c-37f7fa75297e tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:21.505515 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a30b4dda-f866-4988-9e3c-37f7fa75297e tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:21.513813 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a30b4dda-f866-4988-9e3c-37f7fa75297e tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1673 microversion: 2.1 time: 0.176555 Jul 04 04:29:21.514413 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 563/1154] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:21 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:22.531357 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-0ef6ef75-bd3a-47f7-b91f-49a61b2a5550 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:22.531962 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-0ef6ef75-bd3a-47f7-b91f-49a61b2a5550 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:22.539159 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0ef6ef75-bd3a-47f7-b91f-49a61b2a5550 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:22.539608 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0ef6ef75-bd3a-47f7-b91f-49a61b2a5550 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:22.540369 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0ef6ef75-bd3a-47f7-b91f-49a61b2a5550 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:22.540803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0ef6ef75-bd3a-47f7-b91f-49a61b2a5550 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:22.679113 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-0ef6ef75-bd3a-47f7-b91f-49a61b2a5550 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:22.687502 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-0ef6ef75-bd3a-47f7-b91f-49a61b2a5550 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1673 microversion: 2.1 time: 0.160001 Jul 04 04:29:22.688075 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 592/1155] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:22 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:23.708704 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-849a53cb-301a-4d9b-8d13-fd2e1deb8def tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:23.709703 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-849a53cb-301a-4d9b-8d13-fd2e1deb8def tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:23.721001 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-849a53cb-301a-4d9b-8d13-fd2e1deb8def tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:23.721751 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-849a53cb-301a-4d9b-8d13-fd2e1deb8def tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:23.723038 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-849a53cb-301a-4d9b-8d13-fd2e1deb8def tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:23.723751 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-849a53cb-301a-4d9b-8d13-fd2e1deb8def tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:23.867761 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-849a53cb-301a-4d9b-8d13-fd2e1deb8def tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:23.877586 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-849a53cb-301a-4d9b-8d13-fd2e1deb8def tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1673 microversion: 2.1 time: 0.174974 Jul 04 04:29:23.878453 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 564/1156] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:23 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:24.897455 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e50e31b3-81f7-408a-a50c-149419a88e8b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:24.898146 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e50e31b3-81f7-408a-a50c-149419a88e8b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:24.905083 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e50e31b3-81f7-408a-a50c-149419a88e8b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:24.905544 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e50e31b3-81f7-408a-a50c-149419a88e8b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:24.906314 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e50e31b3-81f7-408a-a50c-149419a88e8b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:24.906740 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e50e31b3-81f7-408a-a50c-149419a88e8b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:25.042071 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-e50e31b3-81f7-408a-a50c-149419a88e8b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf66c5198f24f7cbc39132635c03611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd3f8996b5b46f6904e32023b092e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:25.051059 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e50e31b3-81f7-408a-a50c-149419a88e8b tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 200 len: 1673 microversion: 2.1 time: 0.157666 Jul 04 04:29:25.051638 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 593/1157] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:24 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:25.399177 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-3a19b7ff-e865-4361-aaab-52cbf43eb62b req-0c8ff3bd-aadb-4fb5-83b8-78e44c2e827f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33838c72-5e62-4317-ab27-5e45d243c3ec", "name": "network-vif-deleted", "tag": "70b5cda6-ca03-4f8e-a787-c270f412d879"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:29:25.408170 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-3a19b7ff-e865-4361-aaab-52cbf43eb62b req-0c8ff3bd-aadb-4fb5-83b8-78e44c2e827f service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:25.408609 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-3a19b7ff-e865-4361-aaab-52cbf43eb62b req-0c8ff3bd-aadb-4fb5-83b8-78e44c2e827f service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:25.420522 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-3a19b7ff-e865-4361-aaab-52cbf43eb62b req-0c8ff3bd-aadb-4fb5-83b8-78e44c2e827f service nova] Creating event network-vif-deleted:70b5cda6-ca03-4f8e-a787-c270f412d879 for instance 33838c72-5e62-4317-ab27-5e45d243c3ec on hv-cinder-74216 Jul 04 04:29:25.425719 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-3a19b7ff-e865-4361-aaab-52cbf43eb62b req-0c8ff3bd-aadb-4fb5-83b8-78e44c2e827f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030377 Jul 04 04:29:25.426758 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 565/1158] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:29:26.068833 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-82d8d763-ce66-43a0-85c8-4c57a2d0608d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:26.069626 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-82d8d763-ce66-43a0-85c8-4c57a2d0608d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:26.076434 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-82d8d763-ce66-43a0-85c8-4c57a2d0608d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:26.076869 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-82d8d763-ce66-43a0-85c8-4c57a2d0608d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:26.077646 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-82d8d763-ce66-43a0-85c8-4c57a2d0608d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:26.078081 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-82d8d763-ce66-43a0-85c8-4c57a2d0608d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:26.092980 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-82d8d763-ce66-43a0-85c8-4c57a2d0608d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] HTTP exception thrown: Instance 33838c72-5e62-4317-ab27-5e45d243c3ec could not be found. Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-82d8d763-ce66-43a0-85c8-4c57a2d0608d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Request method failure captured: Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec HTTP/1.1 Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmrfaO3tTuR89AMFKfPX0RdTd_VKxHyXE_3Q3jQmPssjDPyF3KwI1Yk73lT9bZ8JO3DYK0VwahirWvx4zORYpmB2Q897B1s5tSXtsUuULSWkNKhZ2FkTOChTg7TEkduf-y8AGc2z617FeDLT_dJwQxhoe5ZJ4ZqE126qAXFYT4sqMW4 Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: 0bd3f8996b5b46f6904e32023b092e5d Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-AttachVolumeTestJSON-1160839055 Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:29:26.094909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:29:26.096837 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0bd3f8996b5b46f6904e32023b092e5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0bd3f8996b5b46f6904e32023b092e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0bd3f8996b5b46f6904e32023b092e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0bd3f8996b5b46f6904e32023b092e5d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:29:26.096837 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-AttachVolumeTestJSON-1160839055 Jul 04 04:29:26.096837 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: 0bd3f8996b5b46f6904e32023b092e5d Jul 04 04:29:26.096837 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1160839055 Jul 04 04:29:26.096837 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-AttachVolumeTestJSON-1160839055-project Jul 04 04:29:26.096837 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:29:26.096837 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:29:26.096837 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: ccf66c5198f24f7cbc39132635c03611 Jul 04 04:29:26.096837 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-AttachVolumeTestJSON-1160839055-project Jul 04 04:29:26.096837 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:29:26.096837 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance 33838c72-5e62-4317-ab27-5e45d243c3ec could not be found. Jul 04 04:29:26.096837 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': '33838c72-5e62-4317-ab27-5e45d243c3ec'} Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33838c72-5e62-4317-ab27-5e45d243c3ec could not be found. Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:29:26.098123 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:29:26.099698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:29:26.099698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:29:26.099698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:29:26.099698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:29:26.099698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:29:26.099698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:29:26.099698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:29:26.099698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33838c72-5e62-4317-ab27-5e45d243c3ec could not be found. Jul 04 04:29:26.099698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:29:26.099698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:29:26.099698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:29:26.099698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:29:26.099698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:29:26.099698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:29:26.099698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:29:26.099698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:29:26.099698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33838c72-5e62-4317-ab27-5e45d243c3ec could not be found. Jul 04 04:29:26.099698 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:29:26.101710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-82d8d763-ce66-43a0-85c8-4c57a2d0608d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Returning 404 to user: Instance 33838c72-5e62-4317-ab27-5e45d243c3ec could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:29:26.101710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-82d8d763-ce66-43a0-85c8-4c57a2d0608d tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 404 len: 111 microversion: 2.1 time: 0.031944 Jul 04 04:29:26.101710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 594/1159] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:26 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:29:26.107784 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-442b64f8-04c5-4329-8688-b1bd4edb7079 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '.version_select at 0x7f50c0fda940>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:26.110970 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR oslo.messaging._drivers.impl_rabbit [None req-442b64f8-04c5-4329-8688-b1bd4edb7079 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [9c7ee1ff-5077-40ba-ab57-a7e6dce74e12] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 04 04:29:26.921730 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-e7627815-8147-4732-ad47-f749486b3537 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:26.922226 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-e7627815-8147-4732-ad47-f749486b3537 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:26.929154 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7627815-8147-4732-ad47-f749486b3537 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:26.929601 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7627815-8147-4732-ad47-f749486b3537 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:26.930392 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7627815-8147-4732-ad47-f749486b3537 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:26.930841 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-e7627815-8147-4732-ad47-f749486b3537 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:27.015627 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.objects.instance [None req-e7627815-8147-4732-ad47-f749486b3537 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lazy-loading 'services' on Instance uuid 22d7a844-bd93-4a53-9c7d-b05eb08d0127 {{(pid=117875) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:29:27.091156 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-e7627815-8147-4732-ad47-f749486b3537 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127/os-volume_attachments/61f71570-b09f-4ad8-a147-0bea2ebae7ad" status: 202 len: 0 microversion: 2.1 time: 0.173255 Jul 04 04:29:27.091783 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 595/1160] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jul 4 04:29:26 2022] DELETE /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127/os-volume_attachments/61f71570-b09f-4ad8-a147-0bea2ebae7ad => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:29:27.120247 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [None req-442b64f8-04c5-4329-8688-b1bd4edb7079 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [9c7ee1ff-5077-40ba-ab57-a7e6dce74e12] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60686. Jul 04 04:29:27.148978 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-442b64f8-04c5-4329-8688-b1bd4edb7079 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-660883046" status: 202 len: 0 microversion: 2.1 time: 1.039467 Jul 04 04:29:27.148978 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 566/1161] 10.222.0.16 () {58 vars in 1217 bytes} [Mon Jul 4 04:29:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-660883046 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:29:28.215574 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-a5750e57-4e5b-43f5-a765-2c564accc0d1 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:28.216155 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a5750e57-4e5b-43f5-a765-2c564accc0d1 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:28.222533 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a5750e57-4e5b-43f5-a765-2c564accc0d1 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:28.222950 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a5750e57-4e5b-43f5-a765-2c564accc0d1 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:28.223710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a5750e57-4e5b-43f5-a765-2c564accc0d1 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:28.224214 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-a5750e57-4e5b-43f5-a765-2c564accc0d1 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:28.249365 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-a5750e57-4e5b-43f5-a765-2c564accc0d1 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] Going to try to terminate instance {{(pid=117875) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:29:28.338865 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-a5750e57-4e5b-43f5-a765-2c564accc0d1 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127" status: 204 len: 0 microversion: 2.1 time: 0.127517 Jul 04 04:29:28.339891 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 596/1162] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:29:28 2022] DELETE /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:29:28.348994 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f8682608-e011-416e-9e90-704f8c679227 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:28.350180 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f8682608-e011-416e-9e90-704f8c679227 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:28.356932 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8682608-e011-416e-9e90-704f8c679227 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:28.357381 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8682608-e011-416e-9e90-704f8c679227 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:28.358185 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8682608-e011-416e-9e90-704f8c679227 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:28.358627 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f8682608-e011-416e-9e90-704f8c679227 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:28.489051 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f8682608-e011-416e-9e90-704f8c679227 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:28.501508 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f8682608-e011-416e-9e90-704f8c679227 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127" status: 200 len: 1515 microversion: 2.1 time: 0.156984 Jul 04 04:29:28.502323 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 567/1163] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:28 2022] GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:29.523326 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c4075a56-9cd8-4df0-8fb9-4248c4aad4c4 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:29.524412 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c4075a56-9cd8-4df0-8fb9-4248c4aad4c4 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:29.532365 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c4075a56-9cd8-4df0-8fb9-4248c4aad4c4 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:29.532928 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c4075a56-9cd8-4df0-8fb9-4248c4aad4c4 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:29.534098 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c4075a56-9cd8-4df0-8fb9-4248c4aad4c4 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:29.534780 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c4075a56-9cd8-4df0-8fb9-4248c4aad4c4 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:29.684619 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c4075a56-9cd8-4df0-8fb9-4248c4aad4c4 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:29.692465 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c4075a56-9cd8-4df0-8fb9-4248c4aad4c4 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127" status: 200 len: 1515 microversion: 2.1 time: 0.175356 Jul 04 04:29:29.693014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 597/1164] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:29 2022] GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:30.099498 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8e7082c4-8fa7-45b0-82a6-061a64476833 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:30.100077 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8e7082c4-8fa7-45b0-82a6-061a64476833 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:30.107393 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e7082c4-8fa7-45b0-82a6-061a64476833 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:30.107891 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e7082c4-8fa7-45b0-82a6-061a64476833 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:30.108739 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e7082c4-8fa7-45b0-82a6-061a64476833 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:30.109241 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e7082c4-8fa7-45b0-82a6-061a64476833 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:30.124197 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-8e7082c4-8fa7-45b0-82a6-061a64476833 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] HTTP exception thrown: Instance 33838c72-5e62-4317-ab27-5e45d243c3ec could not be found. Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8e7082c4-8fa7-45b0-82a6-061a64476833 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Request method failure captured: Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec HTTP/1.1 Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmrfaO3tTuR89AMFKfPX0RdTd_VKxHyXE_3Q3jQmPssjDPyF3KwI1Yk73lT9bZ8JO3DYK0VwahirWvx4zORYpmB2Q897B1s5tSXtsUuULSWkNKhZ2FkTOChTg7TEkduf-y8AGc2z617FeDLT_dJwQxhoe5ZJ4ZqE126qAXFYT4sqMW4 Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 0bd3f8996b5b46f6904e32023b092e5d Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeTestJSON-1160839055 Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:29:30.125861 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:29:30.127454 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0bd3f8996b5b46f6904e32023b092e5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0bd3f8996b5b46f6904e32023b092e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0bd3f8996b5b46f6904e32023b092e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0bd3f8996b5b46f6904e32023b092e5d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:29:30.127454 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeTestJSON-1160839055 Jul 04 04:29:30.127454 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 0bd3f8996b5b46f6904e32023b092e5d Jul 04 04:29:30.127454 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1160839055 Jul 04 04:29:30.127454 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeTestJSON-1160839055-project Jul 04 04:29:30.127454 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:29:30.127454 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:29:30.127454 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: ccf66c5198f24f7cbc39132635c03611 Jul 04 04:29:30.127454 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeTestJSON-1160839055-project Jul 04 04:29:30.127454 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:29:30.127454 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance 33838c72-5e62-4317-ab27-5e45d243c3ec could not be found. Jul 04 04:29:30.127454 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': '33838c72-5e62-4317-ab27-5e45d243c3ec'} Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33838c72-5e62-4317-ab27-5e45d243c3ec could not be found. Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:29:30.128434 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33838c72-5e62-4317-ab27-5e45d243c3ec could not be found. Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33838c72-5e62-4317-ab27-5e45d243c3ec could not be found. Jul 04 04:29:30.129999 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:29:30.131570 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8e7082c4-8fa7-45b0-82a6-061a64476833 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Returning 404 to user: Instance 33838c72-5e62-4317-ab27-5e45d243c3ec could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:29:30.131570 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8e7082c4-8fa7-45b0-82a6-061a64476833 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "DELETE /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 404 len: 111 microversion: 2.1 time: 0.032199 Jul 04 04:29:30.131570 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 568/1165] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:29:30 2022] DELETE /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:29:30.136271 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9e9024ba-8d19-4d5b-ad92-110bc7366199 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:30.136887 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-9e9024ba-8d19-4d5b-ad92-110bc7366199 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: 33838c72-5e62-4317-ab27-5e45d243c3ec] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:30.143435 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9e9024ba-8d19-4d5b-ad92-110bc7366199 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:30.143885 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9e9024ba-8d19-4d5b-ad92-110bc7366199 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:30.144652 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9e9024ba-8d19-4d5b-ad92-110bc7366199 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:30.145086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9e9024ba-8d19-4d5b-ad92-110bc7366199 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:30.158649 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-9e9024ba-8d19-4d5b-ad92-110bc7366199 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] HTTP exception thrown: Instance 33838c72-5e62-4317-ab27-5e45d243c3ec could not be found. Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9e9024ba-8d19-4d5b-ad92-110bc7366199 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Request method failure captured: Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec HTTP/1.1 Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmrfaO3tTuR89AMFKfPX0RdTd_VKxHyXE_3Q3jQmPssjDPyF3KwI1Yk73lT9bZ8JO3DYK0VwahirWvx4zORYpmB2Q897B1s5tSXtsUuULSWkNKhZ2FkTOChTg7TEkduf-y8AGc2z617FeDLT_dJwQxhoe5ZJ4ZqE126qAXFYT4sqMW4 Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: 0bd3f8996b5b46f6904e32023b092e5d Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-AttachVolumeTestJSON-1160839055 Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:29:30.160321 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:29:30.162065 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0bd3f8996b5b46f6904e32023b092e5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0bd3f8996b5b46f6904e32023b092e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0bd3f8996b5b46f6904e32023b092e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0bd3f8996b5b46f6904e32023b092e5d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:29:30.162065 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-AttachVolumeTestJSON-1160839055 Jul 04 04:29:30.162065 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: 0bd3f8996b5b46f6904e32023b092e5d Jul 04 04:29:30.162065 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1160839055 Jul 04 04:29:30.162065 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-AttachVolumeTestJSON-1160839055-project Jul 04 04:29:30.162065 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:29:30.162065 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:29:30.162065 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: ccf66c5198f24f7cbc39132635c03611 Jul 04 04:29:30.162065 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-AttachVolumeTestJSON-1160839055-project Jul 04 04:29:30.162065 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:29:30.162065 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance 33838c72-5e62-4317-ab27-5e45d243c3ec could not be found. Jul 04 04:29:30.162065 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': '33838c72-5e62-4317-ab27-5e45d243c3ec'} Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33838c72-5e62-4317-ab27-5e45d243c3ec could not be found. Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:29:30.163086 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:29:30.164484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:29:30.164484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:29:30.164484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:29:30.164484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:29:30.164484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:29:30.164484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:29:30.164484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:29:30.164484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33838c72-5e62-4317-ab27-5e45d243c3ec could not be found. Jul 04 04:29:30.164484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:29:30.164484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:29:30.164484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:29:30.164484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:29:30.164484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:29:30.164484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:29:30.164484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:29:30.164484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:29:30.164484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33838c72-5e62-4317-ab27-5e45d243c3ec could not be found. Jul 04 04:29:30.164484 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:29:30.168459 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9e9024ba-8d19-4d5b-ad92-110bc7366199 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Returning 404 to user: Instance 33838c72-5e62-4317-ab27-5e45d243c3ec could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:29:30.168459 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9e9024ba-8d19-4d5b-ad92-110bc7366199 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec" status: 404 len: 111 microversion: 2.1 time: 0.029742 Jul 04 04:29:30.168459 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 598/1166] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:30 2022] GET /compute/v2.1/servers/33838c72-5e62-4317-ab27-5e45d243c3ec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:29:30.709626 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-980ad9be-6305-42b1-8dbb-82dabe01bedd tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:30.710263 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-980ad9be-6305-42b1-8dbb-82dabe01bedd tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:30.717173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-980ad9be-6305-42b1-8dbb-82dabe01bedd tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:30.717631 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-980ad9be-6305-42b1-8dbb-82dabe01bedd tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:30.718397 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-980ad9be-6305-42b1-8dbb-82dabe01bedd tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:30.718874 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-980ad9be-6305-42b1-8dbb-82dabe01bedd tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:30.909494 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-980ad9be-6305-42b1-8dbb-82dabe01bedd tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:30.917873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-980ad9be-6305-42b1-8dbb-82dabe01bedd tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127" status: 200 len: 1515 microversion: 2.1 time: 0.212182 Jul 04 04:29:30.918472 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 569/1167] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:30 2022] GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127 => generated 1515 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:31.014259 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-8c0fa79f-5965-4593-9cba-b5b2d5cd98be req-c9369c35-257c-4c40-ba23-d74f0479e3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d7a844-bd93-4a53-9c7d-b05eb08d0127", "name": "network-vif-deleted", "tag": "6551ebc5-7d05-4db4-b4ea-83a4ac8aa497"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:29:31.024634 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-8c0fa79f-5965-4593-9cba-b5b2d5cd98be req-c9369c35-257c-4c40-ba23-d74f0479e3c4 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:31.025071 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-8c0fa79f-5965-4593-9cba-b5b2d5cd98be req-c9369c35-257c-4c40-ba23-d74f0479e3c4 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:31.037499 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-8c0fa79f-5965-4593-9cba-b5b2d5cd98be req-c9369c35-257c-4c40-ba23-d74f0479e3c4 service nova] Creating event network-vif-deleted:6551ebc5-7d05-4db4-b4ea-83a4ac8aa497 for instance 22d7a844-bd93-4a53-9c7d-b05eb08d0127 on hv-cinder-74216 Jul 04 04:29:31.043349 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-8c0fa79f-5965-4593-9cba-b5b2d5cd98be req-c9369c35-257c-4c40-ba23-d74f0479e3c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032748 Jul 04 04:29:31.043996 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 599/1168] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:29:31.309941 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fbf11d5a-e177-483f-b22b-018b42c6976f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:31.310489 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fbf11d5a-e177-483f-b22b-018b42c6976f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:31.317283 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fbf11d5a-e177-483f-b22b-018b42c6976f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:31.317736 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fbf11d5a-e177-483f-b22b-018b42c6976f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:31.318604 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fbf11d5a-e177-483f-b22b-018b42c6976f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:31.319040 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fbf11d5a-e177-483f-b22b-018b42c6976f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:31.332630 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-fbf11d5a-e177-483f-b22b-018b42c6976f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] HTTP exception thrown: Instance fb5a126f-e314-44bc-8697-7b07760da296 could not be found. Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fbf11d5a-e177-483f-b22b-018b42c6976f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Request method failure captured: Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 HTTP/1.1 Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmrfaO3tTuR89AMFKfPX0RdTd_VKxHyXE_3Q3jQmPssjDPyF3KwI1Yk73lT9bZ8JO3DYK0VwahirWvx4zORYpmB2Q897B1s5tSXtsUuULSWkNKhZ2FkTOChTg7TEkduf-y8AGc2z617FeDLT_dJwQxhoe5ZJ4ZqE126qAXFYT4sqMW4 Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 0bd3f8996b5b46f6904e32023b092e5d Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeTestJSON-1160839055 Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:29:31.334173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:29:31.335727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0bd3f8996b5b46f6904e32023b092e5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0bd3f8996b5b46f6904e32023b092e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0bd3f8996b5b46f6904e32023b092e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0bd3f8996b5b46f6904e32023b092e5d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:29:31.335727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeTestJSON-1160839055 Jul 04 04:29:31.335727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 0bd3f8996b5b46f6904e32023b092e5d Jul 04 04:29:31.335727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1160839055 Jul 04 04:29:31.335727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeTestJSON-1160839055-project Jul 04 04:29:31.335727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:29:31.335727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:29:31.335727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: ccf66c5198f24f7cbc39132635c03611 Jul 04 04:29:31.335727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeTestJSON-1160839055-project Jul 04 04:29:31.335727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:29:31.335727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance fb5a126f-e314-44bc-8697-7b07760da296 could not be found. Jul 04 04:29:31.335727 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': 'fb5a126f-e314-44bc-8697-7b07760da296'} Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5a126f-e314-44bc-8697-7b07760da296 could not be found. Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:29:31.336873 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5a126f-e314-44bc-8697-7b07760da296 could not be found. Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5a126f-e314-44bc-8697-7b07760da296 could not be found. Jul 04 04:29:31.338461 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:29:31.339907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fbf11d5a-e177-483f-b22b-018b42c6976f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Returning 404 to user: Instance fb5a126f-e314-44bc-8697-7b07760da296 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:29:31.339907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fbf11d5a-e177-483f-b22b-018b42c6976f tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 404 len: 111 microversion: 2.1 time: 0.029585 Jul 04 04:29:31.339907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 570/1169] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:29:31 2022] DELETE /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:29:31.344858 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-028d3499-c641-46b8-8848-0bbc99e5f451 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:31.345555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-028d3499-c641-46b8-8848-0bbc99e5f451 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] [instance: fb5a126f-e314-44bc-8697-7b07760da296] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:31.352228 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-028d3499-c641-46b8-8848-0bbc99e5f451 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:31.352779 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-028d3499-c641-46b8-8848-0bbc99e5f451 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:31.353551 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-028d3499-c641-46b8-8848-0bbc99e5f451 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:31.353988 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-028d3499-c641-46b8-8848-0bbc99e5f451 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:31.367995 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-028d3499-c641-46b8-8848-0bbc99e5f451 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] HTTP exception thrown: Instance fb5a126f-e314-44bc-8697-7b07760da296 could not be found. Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-028d3499-c641-46b8-8848-0bbc99e5f451 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Request method failure captured: Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 HTTP/1.1 Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmrfaO3tTuR89AMFKfPX0RdTd_VKxHyXE_3Q3jQmPssjDPyF3KwI1Yk73lT9bZ8JO3DYK0VwahirWvx4zORYpmB2Q897B1s5tSXtsUuULSWkNKhZ2FkTOChTg7TEkduf-y8AGc2z617FeDLT_dJwQxhoe5ZJ4ZqE126qAXFYT4sqMW4 Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: 0bd3f8996b5b46f6904e32023b092e5d Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-AttachVolumeTestJSON-1160839055 Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:29:31.369616 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:29:31.371359 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0bd3f8996b5b46f6904e32023b092e5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0bd3f8996b5b46f6904e32023b092e5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0bd3f8996b5b46f6904e32023b092e5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0bd3f8996b5b46f6904e32023b092e5d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:29:31.371359 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-AttachVolumeTestJSON-1160839055 Jul 04 04:29:31.371359 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: 0bd3f8996b5b46f6904e32023b092e5d Jul 04 04:29:31.371359 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1160839055 Jul 04 04:29:31.371359 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-AttachVolumeTestJSON-1160839055-project Jul 04 04:29:31.371359 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:29:31.371359 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:29:31.371359 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: ccf66c5198f24f7cbc39132635c03611 Jul 04 04:29:31.371359 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-AttachVolumeTestJSON-1160839055-project Jul 04 04:29:31.371359 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:29:31.371359 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance fb5a126f-e314-44bc-8697-7b07760da296 could not be found. Jul 04 04:29:31.371359 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': 'fb5a126f-e314-44bc-8697-7b07760da296'} Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5a126f-e314-44bc-8697-7b07760da296 could not be found. Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:29:31.372331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:29:31.373596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:29:31.373596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:29:31.373596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:29:31.373596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:29:31.373596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:29:31.373596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:29:31.373596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:29:31.373596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5a126f-e314-44bc-8697-7b07760da296 could not be found. Jul 04 04:29:31.373596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:29:31.373596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:29:31.373596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:29:31.373596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:29:31.373596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:29:31.373596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:29:31.373596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:29:31.373596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:29:31.373596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5a126f-e314-44bc-8697-7b07760da296 could not be found. Jul 04 04:29:31.373596 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:29:31.374958 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-028d3499-c641-46b8-8848-0bbc99e5f451 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] Returning 404 to user: Instance fb5a126f-e314-44bc-8697-7b07760da296 could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:29:31.374958 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-028d3499-c641-46b8-8848-0bbc99e5f451 tempest-AttachVolumeTestJSON-1160839055 tempest-AttachVolumeTestJSON-1160839055-project] 10.222.0.16 "GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296" status: 404 len: 111 microversion: 2.1 time: 0.030522 Jul 04 04:29:31.374958 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 600/1170] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:31 2022] GET /compute/v2.1/servers/fb5a126f-e314-44bc-8697-7b07760da296 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:29:31.935757 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f1c4429c-7102-421d-8419-8e4745c7ce23 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:31.936371 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f1c4429c-7102-421d-8419-8e4745c7ce23 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 22d7a844-bd93-4a53-9c7d-b05eb08d0127] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:31.942870 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1c4429c-7102-421d-8419-8e4745c7ce23 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:31.943258 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1c4429c-7102-421d-8419-8e4745c7ce23 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:31.944030 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1c4429c-7102-421d-8419-8e4745c7ce23 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:31.944468 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1c4429c-7102-421d-8419-8e4745c7ce23 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:31.959904 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-f1c4429c-7102-421d-8419-8e4745c7ce23 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] HTTP exception thrown: Instance 22d7a844-bd93-4a53-9c7d-b05eb08d0127 could not be found. Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f1c4429c-7102-421d-8419-8e4745c7ce23 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Request method failure captured: Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127 HTTP/1.1 Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmxfd4i_8SECyRdmO7wLvXtg4UOkFGE1MdnzC1nHZpdjWkbocteuw33nDZodxQFccqUjEmO-lURrAhfWHzpw6yNoYcKiP9sflKO3Pi7nZ_eFg3dc4gTs2QNGvuDpyQaErgy4is1Ny8lRANrw0bTpg19SVubSQYp62VNsgSC2Kp48sAw Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 5cfc2721cf3146beb4471ded02b1b637 Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1692342993 Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:29:31.962036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:29:31.963828 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cfc2721cf3146beb4471ded02b1b637"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5cfc2721cf3146beb4471ded02b1b637"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cfc2721cf3146beb4471ded02b1b637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5cfc2721cf3146beb4471ded02b1b637", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:29:31.963828 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-VolumesSnapshotTestJSON-1692342993 Jul 04 04:29:31.963828 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 5cfc2721cf3146beb4471ded02b1b637 Jul 04 04:29:31.963828 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1692342993 Jul 04 04:29:31.963828 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-VolumesSnapshotTestJSON-1692342993-project Jul 04 04:29:31.963828 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:29:31.963828 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:29:31.963828 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: 4e12c4cfe11c4be58991df7173e4533f Jul 04 04:29:31.963828 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-VolumesSnapshotTestJSON-1692342993-project Jul 04 04:29:31.963828 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:29:31.963828 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance 22d7a844-bd93-4a53-9c7d-b05eb08d0127 could not be found. Jul 04 04:29:31.963828 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': '22d7a844-bd93-4a53-9c7d-b05eb08d0127'} Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22d7a844-bd93-4a53-9c7d-b05eb08d0127 could not be found. Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:29:31.968144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:29:31.969603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:29:31.969603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:29:31.969603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:29:31.969603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:29:31.969603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:29:31.969603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:29:31.969603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:29:31.969603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22d7a844-bd93-4a53-9c7d-b05eb08d0127 could not be found. Jul 04 04:29:31.969603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:29:31.969603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:29:31.969603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:29:31.969603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:29:31.969603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:29:31.969603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:29:31.969603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:29:31.969603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:29:31.969603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22d7a844-bd93-4a53-9c7d-b05eb08d0127 could not be found. Jul 04 04:29:31.969603 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:29:31.971001 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f1c4429c-7102-421d-8419-8e4745c7ce23 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Returning 404 to user: Instance 22d7a844-bd93-4a53-9c7d-b05eb08d0127 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:29:31.971001 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f1c4429c-7102-421d-8419-8e4745c7ce23 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127" status: 404 len: 111 microversion: 2.1 time: 0.032213 Jul 04 04:29:31.971001 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 571/1171] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:31 2022] GET /compute/v2.1/servers/22d7a844-bd93-4a53-9c7d-b05eb08d0127 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:29:41.907906 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7a3dc5b1-3052-4152-a537-1a07664cecda tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1308838218", "imageRef": "46b9937d-f997-401a-a3aa-bb9028764454", "flavorRef": "452", "networks": [{"uuid": "ea2047cf-f0f5-4c3d-b4c0-929a4b72175b"}]}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:29:41.915597 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:29:41.916250 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:29:42.205993 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.network.neutron [None req-7a3dc5b1-3052-4152-a537-1a07664cecda tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] validate_networks() for [('ea2047cf-f0f5-4c3d-b4c0-929a4b72175b', None, None, None, None, None)] {{(pid=117875) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 04:29:42.648476 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-7a3dc5b1-3052-4152-a537-1a07664cecda tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Flavor limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 04:29:42.648897 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-7a3dc5b1-3052-4152-a537-1a07664cecda tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Image limits 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 04:29:42.649382 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-7a3dc5b1-3052-4152-a537-1a07664cecda tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Flavor pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 04:29:42.649772 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-7a3dc5b1-3052-4152-a537-1a07664cecda tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Image pref 0:0:0 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 04:29:42.650180 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.virt.hardware [None req-7a3dc5b1-3052-4152-a537-1a07664cecda tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117875) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 04:29:42.659257 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7a3dc5b1-3052-4152-a537-1a07664cecda tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:42.659702 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7a3dc5b1-3052-4152-a537-1a07664cecda tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:42.660489 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7a3dc5b1-3052-4152-a537-1a07664cecda tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:42.661256 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7a3dc5b1-3052-4152-a537-1a07664cecda tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:42.679379 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-7a3dc5b1-3052-4152-a537-1a07664cecda tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Getting quotas for project 5cfc2721cf3146beb4471ded02b1b637. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 04:29:42.683741 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.quota [None req-7a3dc5b1-3052-4152-a537-1a07664cecda tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Getting quotas for user 4e12c4cfe11c4be58991df7173e4533f and project 5cfc2721cf3146beb4471ded02b1b637. Resources: {'cores', 'instances', 'ram'} {{(pid=117875) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 04:29:42.694972 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7a3dc5b1-3052-4152-a537-1a07664cecda tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Going to run 1 instances... {{(pid=117875) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 04:29:42.697283 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7a3dc5b1-3052-4152-a537-1a07664cecda tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46b9937d-f997-401a-a3aa-bb9028764454',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117875) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 04:29:42.743857 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7a3dc5b1-3052-4152-a537-1a07664cecda tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.839683 Jul 04 04:29:42.744789 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 601/1172] 10.222.0.16 () {60 vars in 1146 bytes} [Mon Jul 4 04:29:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 04:29:42.754995 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b0088269-4987-40b1-91f5-0be890e427f0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:42.755759 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b0088269-4987-40b1-91f5-0be890e427f0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:42.760088 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:29:42.763854 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:29:43.107419 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b0088269-4987-40b1-91f5-0be890e427f0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:43.116173 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b0088269-4987-40b1-91f5-0be890e427f0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d" status: 200 len: 1219 microversion: 2.1 time: 0.365249 Jul 04 04:29:43.117510 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 572/1173] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:42 2022] GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d => generated 1219 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:44.133273 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-1902b92b-e703-4c15-9f13-38243a77a220 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:44.134025 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-1902b92b-e703-4c15-9f13-38243a77a220 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:44.141658 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1902b92b-e703-4c15-9f13-38243a77a220 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:44.142327 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1902b92b-e703-4c15-9f13-38243a77a220 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:44.143346 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1902b92b-e703-4c15-9f13-38243a77a220 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:44.143868 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-1902b92b-e703-4c15-9f13-38243a77a220 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:44.218205 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-1902b92b-e703-4c15-9f13-38243a77a220 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:44.226735 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-1902b92b-e703-4c15-9f13-38243a77a220 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d" status: 200 len: 1277 microversion: 2.1 time: 0.097558 Jul 04 04:29:44.227311 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 602/1174] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:44 2022] GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d => generated 1277 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:45.155945 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-7863cfea-c95f-44f4-a452-cb849f171b87 req-c22acf12-decc-430b-a2c8-69ce379a3995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65350fa5-f7af-4d3f-a93c-3d18371cb89d", "tag": "b3414092-341d-4e63-ae1e-5b6161b366f8"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:29:45.167134 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-7863cfea-c95f-44f4-a452-cb849f171b87 req-c22acf12-decc-430b-a2c8-69ce379a3995 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:45.167907 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-7863cfea-c95f-44f4-a452-cb849f171b87 req-c22acf12-decc-430b-a2c8-69ce379a3995 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:45.180480 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-7863cfea-c95f-44f4-a452-cb849f171b87 req-c22acf12-decc-430b-a2c8-69ce379a3995 service nova] Creating event network-changed:b3414092-341d-4e63-ae1e-5b6161b366f8 for instance 65350fa5-f7af-4d3f-a93c-3d18371cb89d on hv-cinder-74216 Jul 04 04:29:45.185707 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-7863cfea-c95f-44f4-a452-cb849f171b87 req-c22acf12-decc-430b-a2c8-69ce379a3995 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033866 Jul 04 04:29:45.186311 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 573/1175] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:29:45.246559 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-46d9cc9a-81f2-47de-98bf-1b5222c6b9c8 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:45.247183 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-46d9cc9a-81f2-47de-98bf-1b5222c6b9c8 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:45.253908 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-46d9cc9a-81f2-47de-98bf-1b5222c6b9c8 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:45.254346 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-46d9cc9a-81f2-47de-98bf-1b5222c6b9c8 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:45.255174 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-46d9cc9a-81f2-47de-98bf-1b5222c6b9c8 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:45.255603 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-46d9cc9a-81f2-47de-98bf-1b5222c6b9c8 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:45.389340 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-46d9cc9a-81f2-47de-98bf-1b5222c6b9c8 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:45.397009 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-46d9cc9a-81f2-47de-98bf-1b5222c6b9c8 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d" status: 200 len: 1319 microversion: 2.1 time: 0.155005 Jul 04 04:29:45.397577 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 603/1176] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:45 2022] GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:46.415804 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c543495c-112b-4e28-b9bc-c8a631ba3e78 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:46.416537 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c543495c-112b-4e28-b9bc-c8a631ba3e78 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:46.423759 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c543495c-112b-4e28-b9bc-c8a631ba3e78 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:46.424205 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c543495c-112b-4e28-b9bc-c8a631ba3e78 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:46.424976 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c543495c-112b-4e28-b9bc-c8a631ba3e78 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:46.425408 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c543495c-112b-4e28-b9bc-c8a631ba3e78 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:46.854068 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c543495c-112b-4e28-b9bc-c8a631ba3e78 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:46.862199 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c543495c-112b-4e28-b9bc-c8a631ba3e78 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d" status: 200 len: 1319 microversion: 2.1 time: 0.451231 Jul 04 04:29:46.862811 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 574/1177] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:46 2022] GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:47.879395 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-676ddb11-4b37-436e-80fb-4b08be62cc74 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:47.880006 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-676ddb11-4b37-436e-80fb-4b08be62cc74 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:47.887606 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-676ddb11-4b37-436e-80fb-4b08be62cc74 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:47.888111 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-676ddb11-4b37-436e-80fb-4b08be62cc74 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:47.888877 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-676ddb11-4b37-436e-80fb-4b08be62cc74 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:47.889304 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-676ddb11-4b37-436e-80fb-4b08be62cc74 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:48.057150 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-676ddb11-4b37-436e-80fb-4b08be62cc74 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:48.065340 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-676ddb11-4b37-436e-80fb-4b08be62cc74 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d" status: 200 len: 1319 microversion: 2.1 time: 0.189983 Jul 04 04:29:48.065898 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 604/1178] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:47 2022] GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:49.084625 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0859f70d-e685-4a22-83b9-98789c73d470 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:49.085435 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0859f70d-e685-4a22-83b9-98789c73d470 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:49.092046 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0859f70d-e685-4a22-83b9-98789c73d470 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:49.092484 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0859f70d-e685-4a22-83b9-98789c73d470 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:49.093272 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0859f70d-e685-4a22-83b9-98789c73d470 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:49.093685 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0859f70d-e685-4a22-83b9-98789c73d470 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:49.228818 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0859f70d-e685-4a22-83b9-98789c73d470 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:49.236941 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0859f70d-e685-4a22-83b9-98789c73d470 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d" status: 200 len: 1319 microversion: 2.1 time: 0.157038 Jul 04 04:29:49.237796 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 575/1179] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:49 2022] GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:50.253348 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9545c4fb-e969-4050-9c2f-4ff1c62c5d11 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:50.253959 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-9545c4fb-e969-4050-9c2f-4ff1c62c5d11 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:50.261378 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9545c4fb-e969-4050-9c2f-4ff1c62c5d11 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:50.261927 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9545c4fb-e969-4050-9c2f-4ff1c62c5d11 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:50.262736 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9545c4fb-e969-4050-9c2f-4ff1c62c5d11 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:50.263166 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9545c4fb-e969-4050-9c2f-4ff1c62c5d11 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:50.404356 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9545c4fb-e969-4050-9c2f-4ff1c62c5d11 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:50.416778 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9545c4fb-e969-4050-9c2f-4ff1c62c5d11 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d" status: 200 len: 1319 microversion: 2.1 time: 0.166895 Jul 04 04:29:50.417786 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 605/1180] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:50 2022] GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:51.438242 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-711c8317-3c6f-44dc-a9ea-5f6b36f90186 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:51.439378 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-711c8317-3c6f-44dc-a9ea-5f6b36f90186 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:51.453624 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-711c8317-3c6f-44dc-a9ea-5f6b36f90186 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:51.454110 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-711c8317-3c6f-44dc-a9ea-5f6b36f90186 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:51.454964 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-711c8317-3c6f-44dc-a9ea-5f6b36f90186 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:51.455392 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-711c8317-3c6f-44dc-a9ea-5f6b36f90186 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:51.604292 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-711c8317-3c6f-44dc-a9ea-5f6b36f90186 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:51.612650 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-711c8317-3c6f-44dc-a9ea-5f6b36f90186 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d" status: 200 len: 1319 microversion: 2.1 time: 0.181310 Jul 04 04:29:51.613220 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 576/1181] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:51 2022] GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:51.790997 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-a9405724-790b-412d-ba60-85185c33d97f req-ba856208-ff3d-46f5-a2b1-e0534b9b0864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65350fa5-f7af-4d3f-a93c-3d18371cb89d", "name": "network-vif-plugged", "status": "completed", "tag": "b3414092-341d-4e63-ae1e-5b6161b366f8"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:29:51.803183 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-a9405724-790b-412d-ba60-85185c33d97f req-ba856208-ff3d-46f5-a2b1-e0534b9b0864 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:51.803635 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-a9405724-790b-412d-ba60-85185c33d97f req-ba856208-ff3d-46f5-a2b1-e0534b9b0864 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:51.816682 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-a9405724-790b-412d-ba60-85185c33d97f req-ba856208-ff3d-46f5-a2b1-e0534b9b0864 service nova] Creating event network-vif-plugged:b3414092-341d-4e63-ae1e-5b6161b366f8 for instance 65350fa5-f7af-4d3f-a93c-3d18371cb89d on hv-cinder-74216 Jul 04 04:29:51.821725 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-a9405724-790b-412d-ba60-85185c33d97f req-ba856208-ff3d-46f5-a2b1-e0534b9b0864 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034806 Jul 04 04:29:51.822322 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 606/1182] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:29:52.629674 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-206416aa-cdd4-4a08-80f5-6dcf256e3a18 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:52.630239 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-206416aa-cdd4-4a08-80f5-6dcf256e3a18 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:52.637956 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-206416aa-cdd4-4a08-80f5-6dcf256e3a18 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:52.638396 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-206416aa-cdd4-4a08-80f5-6dcf256e3a18 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:52.639262 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-206416aa-cdd4-4a08-80f5-6dcf256e3a18 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:52.639694 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-206416aa-cdd4-4a08-80f5-6dcf256e3a18 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:52.773806 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-206416aa-cdd4-4a08-80f5-6dcf256e3a18 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:52.781560 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-206416aa-cdd4-4a08-80f5-6dcf256e3a18 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d" status: 200 len: 1319 microversion: 2.1 time: 0.155924 Jul 04 04:29:52.782102 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 577/1183] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:52 2022] GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:53.799481 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-7b0231fb-55b4-4c20-b410-7116d0c40942 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:53.800322 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-7b0231fb-55b4-4c20-b410-7116d0c40942 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:53.802586 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=2 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:29:53.803351 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell0:SELECT=6 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:29:53.809752 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7b0231fb-55b4-4c20-b410-7116d0c40942 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:53.810274 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7b0231fb-55b4-4c20-b410-7116d0c40942 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:53.811196 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7b0231fb-55b4-4c20-b410-7116d0c40942 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:53.811627 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-7b0231fb-55b4-4c20-b410-7116d0c40942 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:53.977104 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-7b0231fb-55b4-4c20-b410-7116d0c40942 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:53.986706 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-7b0231fb-55b4-4c20-b410-7116d0c40942 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d" status: 200 len: 1319 microversion: 2.1 time: 0.191401 Jul 04 04:29:53.989279 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 607/1184] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:53 2022] GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:55.008997 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f89114b8-55f7-4bd6-abc6-b948766e0d8c tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:29:55.010082 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f89114b8-55f7-4bd6-abc6-b948766e0d8c tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:55.013220 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:29:55.023115 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f89114b8-55f7-4bd6-abc6-b948766e0d8c tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:55.023858 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f89114b8-55f7-4bd6-abc6-b948766e0d8c tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:55.025138 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f89114b8-55f7-4bd6-abc6-b948766e0d8c tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:55.025908 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f89114b8-55f7-4bd6-abc6-b948766e0d8c tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:55.171467 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f89114b8-55f7-4bd6-abc6-b948766e0d8c tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:29:55.182756 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f89114b8-55f7-4bd6-abc6-b948766e0d8c tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d" status: 200 len: 1508 microversion: 2.1 time: 0.180358 Jul 04 04:29:55.183443 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 578/1185] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:29:55 2022] GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:29:55.202634 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-3eb1a117-f69f-4e03-ae19-4842dda86741 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2080e218-17dc-46da-bf65-97be804871ec", "device": "/dev/sdb"}} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:29:55.204190 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-3eb1a117-f69f-4e03-ae19-4842dda86741 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:29:55.214487 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3eb1a117-f69f-4e03-ae19-4842dda86741 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:55.215099 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3eb1a117-f69f-4e03-ae19-4842dda86741 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:55.216278 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3eb1a117-f69f-4e03-ae19-4842dda86741 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:29:55.216869 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-3eb1a117-f69f-4e03-ae19-4842dda86741 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:29:55.494959 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-3eb1a117-f69f-4e03-ae19-4842dda86741 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "POST /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298655 Jul 04 04:29:55.495595 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 608/1186] 10.222.0.16 () {60 vars in 1322 bytes} [Mon Jul 4 04:29:55 2022] POST /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:30:16.329333 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-51955604-6138-40ef-9e7b-3f2ac078bf38 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:30:16.329941 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-51955604-6138-40ef-9e7b-3f2ac078bf38 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:16.332106 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=16 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:30:16.332789 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=32 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:30:16.339548 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51955604-6138-40ef-9e7b-3f2ac078bf38 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:16.339991 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51955604-6138-40ef-9e7b-3f2ac078bf38 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:16.340756 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51955604-6138-40ef-9e7b-3f2ac078bf38 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:16.341188 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-51955604-6138-40ef-9e7b-3f2ac078bf38 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:16.365672 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-51955604-6138-40ef-9e7b-3f2ac078bf38 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lazy-loading 'flavor' on Instance uuid f0877b0b-09e7-4cfc-87a7-7c95da81096c {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:30:16.447811 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-51955604-6138-40ef-9e7b-3f2ac078bf38 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "POST /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c/action" status: 202 len: 0 microversion: 2.1 time: 0.122361 Jul 04 04:30:16.448433 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 579/1187] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 4 04:30:16 2022] POST /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:30:16.457286 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-58799c12-1fee-4dac-a59f-0c474fff3d37 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:16.457989 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-58799c12-1fee-4dac-a59f-0c474fff3d37 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:16.460734 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:30:16.461472 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:30:16.467336 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-58799c12-1fee-4dac-a59f-0c474fff3d37 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:16.468121 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-58799c12-1fee-4dac-a59f-0c474fff3d37 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:16.468949 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-58799c12-1fee-4dac-a59f-0c474fff3d37 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:16.469456 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-58799c12-1fee-4dac-a59f-0c474fff3d37 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:16.616351 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-58799c12-1fee-4dac-a59f-0c474fff3d37 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:16.624644 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-58799c12-1fee-4dac-a59f-0c474fff3d37 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1568 microversion: 2.1 time: 0.171635 Jul 04 04:30:16.625226 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 609/1188] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:16 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:16.960330 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5c3f979a-ddea-41a7-b3a5-7f64040e27be tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:16.960944 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5c3f979a-ddea-41a7-b3a5-7f64040e27be tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:16.967508 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c3f979a-ddea-41a7-b3a5-7f64040e27be tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:16.967954 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c3f979a-ddea-41a7-b3a5-7f64040e27be tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:16.968713 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c3f979a-ddea-41a7-b3a5-7f64040e27be tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:16.969142 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c3f979a-ddea-41a7-b3a5-7f64040e27be tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:17.052492 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-5c3f979a-ddea-41a7-b3a5-7f64040e27be tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lazy-loading 'services' on Instance uuid 65350fa5-f7af-4d3f-a93c-3d18371cb89d {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:30:17.130859 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5c3f979a-ddea-41a7-b3a5-7f64040e27be tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "DELETE /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d/os-volume_attachments/2080e218-17dc-46da-bf65-97be804871ec" status: 202 len: 0 microversion: 2.1 time: 0.174939 Jul 04 04:30:17.131484 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 580/1189] 10.222.0.16 () {58 vars in 1415 bytes} [Mon Jul 4 04:30:16 2022] DELETE /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d/os-volume_attachments/2080e218-17dc-46da-bf65-97be804871ec => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:30:17.647512 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-75bd3ad3-4899-4988-bde5-7e07bcbd0dc3 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:17.648135 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-75bd3ad3-4899-4988-bde5-7e07bcbd0dc3 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:17.654881 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-75bd3ad3-4899-4988-bde5-7e07bcbd0dc3 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:17.655331 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-75bd3ad3-4899-4988-bde5-7e07bcbd0dc3 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:17.656094 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-75bd3ad3-4899-4988-bde5-7e07bcbd0dc3 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:17.656527 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-75bd3ad3-4899-4988-bde5-7e07bcbd0dc3 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:17.796458 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-75bd3ad3-4899-4988-bde5-7e07bcbd0dc3 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:17.804980 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-75bd3ad3-4899-4988-bde5-7e07bcbd0dc3 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1568 microversion: 2.1 time: 0.164189 Jul 04 04:30:17.805543 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 610/1190] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:17 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:18.254909 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e24f55a0-c6af-4d97-bb5f-2b47e4ce8945 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:18.255769 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e24f55a0-c6af-4d97-bb5f-2b47e4ce8945 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:18.264781 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e24f55a0-c6af-4d97-bb5f-2b47e4ce8945 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:18.264781 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e24f55a0-c6af-4d97-bb5f-2b47e4ce8945 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:18.264781 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e24f55a0-c6af-4d97-bb5f-2b47e4ce8945 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:18.264781 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e24f55a0-c6af-4d97-bb5f-2b47e4ce8945 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:18.289510 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e24f55a0-c6af-4d97-bb5f-2b47e4ce8945 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:30:18.370556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e24f55a0-c6af-4d97-bb5f-2b47e4ce8945 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "DELETE /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d" status: 204 len: 0 microversion: 2.1 time: 0.120240 Jul 04 04:30:18.371163 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 581/1191] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:30:18 2022] DELETE /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:30:18.379839 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d1b8e519-179e-44ec-83a6-b9ed720dc9cb tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:18.380450 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d1b8e519-179e-44ec-83a6-b9ed720dc9cb tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:18.387687 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d1b8e519-179e-44ec-83a6-b9ed720dc9cb tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:18.388141 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d1b8e519-179e-44ec-83a6-b9ed720dc9cb tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:18.388909 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d1b8e519-179e-44ec-83a6-b9ed720dc9cb tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:18.389355 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d1b8e519-179e-44ec-83a6-b9ed720dc9cb tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:18.525091 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d1b8e519-179e-44ec-83a6-b9ed720dc9cb tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:18.532849 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d1b8e519-179e-44ec-83a6-b9ed720dc9cb tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d" status: 200 len: 1514 microversion: 2.1 time: 0.157146 Jul 04 04:30:18.533470 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 611/1192] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:18 2022] GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:18.824482 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-17bd0f1e-3620-4935-a840-7b618369c1ba tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:18.825333 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-17bd0f1e-3620-4935-a840-7b618369c1ba tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:18.832893 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-17bd0f1e-3620-4935-a840-7b618369c1ba tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:18.833440 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-17bd0f1e-3620-4935-a840-7b618369c1ba tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:18.834298 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-17bd0f1e-3620-4935-a840-7b618369c1ba tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:18.834946 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-17bd0f1e-3620-4935-a840-7b618369c1ba tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:18.977762 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-17bd0f1e-3620-4935-a840-7b618369c1ba tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:18.985792 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-17bd0f1e-3620-4935-a840-7b618369c1ba tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1568 microversion: 2.1 time: 0.166464 Jul 04 04:30:18.986392 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 582/1193] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:18 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:19.552602 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-85066026-28e2-419b-b8fb-fd0983805339 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:19.553536 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-85066026-28e2-419b-b8fb-fd0983805339 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:19.568339 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-85066026-28e2-419b-b8fb-fd0983805339 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:19.568773 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-85066026-28e2-419b-b8fb-fd0983805339 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:19.569564 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-85066026-28e2-419b-b8fb-fd0983805339 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:19.570022 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-85066026-28e2-419b-b8fb-fd0983805339 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:19.724765 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-85066026-28e2-419b-b8fb-fd0983805339 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:19.733158 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-85066026-28e2-419b-b8fb-fd0983805339 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d" status: 200 len: 1514 microversion: 2.1 time: 0.186611 Jul 04 04:30:19.733735 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 612/1194] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:19 2022] GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:20.003310 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7480d61c-98aa-450a-88aa-6f10e3595eea tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:20.003955 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7480d61c-98aa-450a-88aa-6f10e3595eea tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:20.011263 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7480d61c-98aa-450a-88aa-6f10e3595eea tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:20.011716 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7480d61c-98aa-450a-88aa-6f10e3595eea tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:20.012509 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7480d61c-98aa-450a-88aa-6f10e3595eea tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:20.012952 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7480d61c-98aa-450a-88aa-6f10e3595eea tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:20.152532 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7480d61c-98aa-450a-88aa-6f10e3595eea tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:20.160458 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7480d61c-98aa-450a-88aa-6f10e3595eea tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1568 microversion: 2.1 time: 0.161250 Jul 04 04:30:20.161046 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 583/1195] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:19 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:20.754324 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-215cea85-640e-4b05-86ec-ea522bce69e6 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:20.755076 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-215cea85-640e-4b05-86ec-ea522bce69e6 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:20.762303 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-215cea85-640e-4b05-86ec-ea522bce69e6 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:20.762779 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-215cea85-640e-4b05-86ec-ea522bce69e6 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:20.763523 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-215cea85-640e-4b05-86ec-ea522bce69e6 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:20.763953 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-215cea85-640e-4b05-86ec-ea522bce69e6 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:20.893868 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-215cea85-640e-4b05-86ec-ea522bce69e6 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:20.901673 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-215cea85-640e-4b05-86ec-ea522bce69e6 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d" status: 200 len: 1514 microversion: 2.1 time: 0.151301 Jul 04 04:30:20.902337 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 613/1196] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:20 2022] GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 04:30:21.177268 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c0bce95d-9060-4291-be66-eeb34636a957 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:21.177889 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c0bce95d-9060-4291-be66-eeb34636a957 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:21.184679 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c0bce95d-9060-4291-be66-eeb34636a957 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:21.185145 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c0bce95d-9060-4291-be66-eeb34636a957 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:21.185910 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c0bce95d-9060-4291-be66-eeb34636a957 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:21.186349 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c0bce95d-9060-4291-be66-eeb34636a957 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:21.321591 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c0bce95d-9060-4291-be66-eeb34636a957 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:21.329344 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c0bce95d-9060-4291-be66-eeb34636a957 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1568 microversion: 2.1 time: 0.156046 Jul 04 04:30:21.330110 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 584/1197] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:21 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:21.920979 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9fb09974-0ea1-408b-a6b7-d11fb98fd59b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:21.921587 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-9fb09974-0ea1-408b-a6b7-d11fb98fd59b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:21.929347 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9fb09974-0ea1-408b-a6b7-d11fb98fd59b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:21.929842 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9fb09974-0ea1-408b-a6b7-d11fb98fd59b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:21.930647 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9fb09974-0ea1-408b-a6b7-d11fb98fd59b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:21.931131 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9fb09974-0ea1-408b-a6b7-d11fb98fd59b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:22.093786 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9fb09974-0ea1-408b-a6b7-d11fb98fd59b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:22.102292 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9fb09974-0ea1-408b-a6b7-d11fb98fd59b tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d" status: 200 len: 1514 microversion: 2.1 time: 0.185863 Jul 04 04:30:22.103014 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 614/1198] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:21 2022] GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:22.347350 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fb0fda07-713b-4658-a899-986f408cb2cd tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:22.347971 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fb0fda07-713b-4658-a899-986f408cb2cd tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:22.354392 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb0fda07-713b-4658-a899-986f408cb2cd tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:22.354932 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb0fda07-713b-4658-a899-986f408cb2cd tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:22.355695 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb0fda07-713b-4658-a899-986f408cb2cd tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:22.356155 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fb0fda07-713b-4658-a899-986f408cb2cd tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:22.498144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fb0fda07-713b-4658-a899-986f408cb2cd tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:22.509857 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fb0fda07-713b-4658-a899-986f408cb2cd tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1568 microversion: 2.1 time: 0.166779 Jul 04 04:30:22.510585 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 585/1199] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:22 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:23.125653 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-84fd4298-71ed-4c30-aef8-c2a3ec5cb2ca tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:23.126559 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-84fd4298-71ed-4c30-aef8-c2a3ec5cb2ca tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:23.136173 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-84fd4298-71ed-4c30-aef8-c2a3ec5cb2ca tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:23.136847 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-84fd4298-71ed-4c30-aef8-c2a3ec5cb2ca tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:23.137922 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-84fd4298-71ed-4c30-aef8-c2a3ec5cb2ca tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:23.138572 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-84fd4298-71ed-4c30-aef8-c2a3ec5cb2ca tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:23.278981 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-84fd4298-71ed-4c30-aef8-c2a3ec5cb2ca tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:23.286905 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-84fd4298-71ed-4c30-aef8-c2a3ec5cb2ca tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d" status: 200 len: 1514 microversion: 2.1 time: 0.166815 Jul 04 04:30:23.287515 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 615/1200] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:23 2022] GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:23.529634 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-abcc9ab9-1c29-4d64-b2d7-e36acdd812b2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:23.530221 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-abcc9ab9-1c29-4d64-b2d7-e36acdd812b2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:23.536741 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abcc9ab9-1c29-4d64-b2d7-e36acdd812b2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:23.537465 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abcc9ab9-1c29-4d64-b2d7-e36acdd812b2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:23.538237 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abcc9ab9-1c29-4d64-b2d7-e36acdd812b2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:23.538717 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abcc9ab9-1c29-4d64-b2d7-e36acdd812b2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:23.778571 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-abcc9ab9-1c29-4d64-b2d7-e36acdd812b2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:23.785774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-abcc9ab9-1c29-4d64-b2d7-e36acdd812b2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1568 microversion: 2.1 time: 0.260960 Jul 04 04:30:23.786331 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 586/1201] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:23 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1568 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:24.109788 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-56ed2e5f-f9a2-4295-8ae6-e79993ab5134 req-5389b55f-bb5b-457c-8c14-d5e743094d2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65350fa5-f7af-4d3f-a93c-3d18371cb89d", "name": "network-vif-deleted", "tag": "b3414092-341d-4e63-ae1e-5b6161b366f8"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:30:24.122152 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-56ed2e5f-f9a2-4295-8ae6-e79993ab5134 req-5389b55f-bb5b-457c-8c14-d5e743094d2c service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:24.122875 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-56ed2e5f-f9a2-4295-8ae6-e79993ab5134 req-5389b55f-bb5b-457c-8c14-d5e743094d2c service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:24.141891 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-56ed2e5f-f9a2-4295-8ae6-e79993ab5134 req-5389b55f-bb5b-457c-8c14-d5e743094d2c service nova] Creating event network-vif-deleted:b3414092-341d-4e63-ae1e-5b6161b366f8 for instance 65350fa5-f7af-4d3f-a93c-3d18371cb89d on hv-cinder-74216 Jul 04 04:30:24.150013 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-56ed2e5f-f9a2-4295-8ae6-e79993ab5134 req-5389b55f-bb5b-457c-8c14-d5e743094d2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044345 Jul 04 04:30:24.151042 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 616/1202] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:30:24.306839 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1d4ed823-7422-4ff1-b436-308b442ad4a0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:24.307452 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1d4ed823-7422-4ff1-b436-308b442ad4a0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:24.316503 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d4ed823-7422-4ff1-b436-308b442ad4a0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:24.316969 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d4ed823-7422-4ff1-b436-308b442ad4a0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:24.317734 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d4ed823-7422-4ff1-b436-308b442ad4a0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:24.318231 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d4ed823-7422-4ff1-b436-308b442ad4a0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:24.350610 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d4ed823-7422-4ff1-b436-308b442ad4a0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:24.351062 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d4ed823-7422-4ff1-b436-308b442ad4a0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:24.351513 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-1d4ed823-7422-4ff1-b436-308b442ad4a0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lazy-loading 'fault' on Instance uuid 65350fa5-f7af-4d3f-a93c-3d18371cb89d {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:30:24.396011 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1d4ed823-7422-4ff1-b436-308b442ad4a0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e12c4cfe11c4be58991df7173e4533f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cfc2721cf3146beb4471ded02b1b637', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:24.403969 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1d4ed823-7422-4ff1-b436-308b442ad4a0 tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d" status: 200 len: 1309 microversion: 2.1 time: 0.101085 Jul 04 04:30:24.404545 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 587/1203] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:24 2022] GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:24.803803 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9fa65017-163b-4bab-83c1-622872f6c8de tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:24.804499 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-9fa65017-163b-4bab-83c1-622872f6c8de tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:24.811167 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9fa65017-163b-4bab-83c1-622872f6c8de tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:24.811442 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9fa65017-163b-4bab-83c1-622872f6c8de tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:24.812214 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9fa65017-163b-4bab-83c1-622872f6c8de tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:24.812655 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9fa65017-163b-4bab-83c1-622872f6c8de tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:24.951298 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9fa65017-163b-4bab-83c1-622872f6c8de tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:24.964182 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9fa65017-163b-4bab-83c1-622872f6c8de tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1568 microversion: 2.1 time: 0.164469 Jul 04 04:30:24.964961 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 617/1204] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:24 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:25.422314 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6b3bd905-f1a2-43b9-ba64-5ada5a5cf7aa tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:25.422950 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6b3bd905-f1a2-43b9-ba64-5ada5a5cf7aa tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] [instance: 65350fa5-f7af-4d3f-a93c-3d18371cb89d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:25.429564 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b3bd905-f1a2-43b9-ba64-5ada5a5cf7aa tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:25.430024 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b3bd905-f1a2-43b9-ba64-5ada5a5cf7aa tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:25.430820 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b3bd905-f1a2-43b9-ba64-5ada5a5cf7aa tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:25.431308 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b3bd905-f1a2-43b9-ba64-5ada5a5cf7aa tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:25.445377 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-6b3bd905-f1a2-43b9-ba64-5ada5a5cf7aa tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] HTTP exception thrown: Instance 65350fa5-f7af-4d3f-a93c-3d18371cb89d could not be found. Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6b3bd905-f1a2-43b9-ba64-5ada5a5cf7aa tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Request method failure captured: Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d HTTP/1.1 Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept: application/json Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Connection: close Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Host: 10.222.0.16 Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABiwmxfd4i_8SECyRdmO7wLvXtg4UOkFGE1MdnzC1nHZpdjWkbocteuw33nDZodxQFccqUjEmO-lURrAhfWHzpw6yNoYcKiP9sflKO3Pi7nZ_eFg3dc4gTs2QNGvuDpyQaErgy4is1Ny8lRANrw0bTpg19SVubSQYp62VNsgSC2Kp48sAw Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Id: 5cfc2721cf3146beb4471ded02b1b637 Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1692342993 Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jul 04 04:30:25.447146 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jul 04 04:30:25.449018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cfc2721cf3146beb4471ded02b1b637"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5cfc2721cf3146beb4471ded02b1b637"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5cfc2721cf3146beb4471ded02b1b637"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5cfc2721cf3146beb4471ded02b1b637", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:30:25.449018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-VolumesSnapshotTestJSON-1692342993 Jul 04 04:30:25.449018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 5cfc2721cf3146beb4471ded02b1b637 Jul 04 04:30:25.449018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1692342993 Jul 04 04:30:25.449018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User: tempest-VolumesSnapshotTestJSON-1692342993-project Jul 04 04:30:25.449018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jul 04 04:30:25.449018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jul 04 04:30:25.449018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Id: 4e12c4cfe11c4be58991df7173e4533f Jul 04 04:30:25.449018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-VolumesSnapshotTestJSON-1692342993-project Jul 04 04:30:25.449018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: method: > Jul 04 04:30:25.449018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: exception: Instance 65350fa5-f7af-4d3f-a93c-3d18371cb89d could not be found. Jul 04 04:30:25.449018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: action_args: {'id': '65350fa5-f7af-4d3f-a93c-3d18371cb89d'} Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65350fa5-f7af-4d3f-a93c-3d18371cb89d could not be found. Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:30:25.449890 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:30:25.451394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:30:25.451394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:30:25.451394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:30:25.451394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:30:25.451394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:30:25.451394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:30:25.451394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:30:25.451394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65350fa5-f7af-4d3f-a93c-3d18371cb89d could not be found. Jul 04 04:30:25.451394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:30:25.451394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:30:25.451394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:30:25.451394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:30:25.451394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:30:25.451394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:30:25.451394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:30:25.451394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:30:25.451394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65350fa5-f7af-4d3f-a93c-3d18371cb89d could not be found. Jul 04 04:30:25.451394 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jul 04 04:30:25.453280 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6b3bd905-f1a2-43b9-ba64-5ada5a5cf7aa tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] Returning 404 to user: Instance 65350fa5-f7af-4d3f-a93c-3d18371cb89d could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:30:25.453280 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6b3bd905-f1a2-43b9-ba64-5ada5a5cf7aa tempest-VolumesSnapshotTestJSON-1692342993 tempest-VolumesSnapshotTestJSON-1692342993-project] 10.222.0.16 "GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d" status: 404 len: 111 microversion: 2.1 time: 0.030624 Jul 04 04:30:25.453280 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 588/1205] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:25 2022] GET /compute/v2.1/servers/65350fa5-f7af-4d3f-a93c-3d18371cb89d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:30:25.985137 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-9a95601c-918c-4536-a2e8-1262cd05fff2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:25.985811 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-9a95601c-918c-4536-a2e8-1262cd05fff2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:25.994520 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9a95601c-918c-4536-a2e8-1262cd05fff2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:25.995162 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9a95601c-918c-4536-a2e8-1262cd05fff2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:25.996400 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9a95601c-918c-4536-a2e8-1262cd05fff2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:25.996938 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-9a95601c-918c-4536-a2e8-1262cd05fff2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:26.131941 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-9a95601c-918c-4536-a2e8-1262cd05fff2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:26.140408 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-9a95601c-918c-4536-a2e8-1262cd05fff2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1568 microversion: 2.1 time: 0.160289 Jul 04 04:30:26.140976 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 618/1206] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:25 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:27.157745 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d47dfb76-aec0-4686-a4a5-24e1b8c95572 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:27.158304 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d47dfb76-aec0-4686-a4a5-24e1b8c95572 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:27.165599 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d47dfb76-aec0-4686-a4a5-24e1b8c95572 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:27.166045 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d47dfb76-aec0-4686-a4a5-24e1b8c95572 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:27.166869 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d47dfb76-aec0-4686-a4a5-24e1b8c95572 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:27.167296 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d47dfb76-aec0-4686-a4a5-24e1b8c95572 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:27.396607 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d47dfb76-aec0-4686-a4a5-24e1b8c95572 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:27.406990 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d47dfb76-aec0-4686-a4a5-24e1b8c95572 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1568 microversion: 2.1 time: 0.252932 Jul 04 04:30:27.407932 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 589/1207] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:27 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:28.428865 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-8e0c37c0-5e7c-47dc-b72f-92f56103cdfa tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:28.429878 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-8e0c37c0-5e7c-47dc-b72f-92f56103cdfa tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:28.442571 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8e0c37c0-5e7c-47dc-b72f-92f56103cdfa tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:28.443307 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8e0c37c0-5e7c-47dc-b72f-92f56103cdfa tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:28.444599 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8e0c37c0-5e7c-47dc-b72f-92f56103cdfa tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:28.445282 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8e0c37c0-5e7c-47dc-b72f-92f56103cdfa tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:28.594747 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-8e0c37c0-5e7c-47dc-b72f-92f56103cdfa tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:28.606322 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-8e0c37c0-5e7c-47dc-b72f-92f56103cdfa tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1568 microversion: 2.1 time: 0.183745 Jul 04 04:30:28.607186 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 619/1208] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:28 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:29.627350 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2a871c05-f7c8-4cd8-901b-0666209e434b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:29.628063 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2a871c05-f7c8-4cd8-901b-0666209e434b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:29.636282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a871c05-f7c8-4cd8-901b-0666209e434b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:29.636792 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a871c05-f7c8-4cd8-901b-0666209e434b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:29.637787 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a871c05-f7c8-4cd8-901b-0666209e434b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:29.638632 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a871c05-f7c8-4cd8-901b-0666209e434b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:29.777909 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2a871c05-f7c8-4cd8-901b-0666209e434b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:29.785796 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2a871c05-f7c8-4cd8-901b-0666209e434b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1568 microversion: 2.1 time: 0.164406 Jul 04 04:30:29.786357 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 590/1209] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:29 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:30.804270 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-837a19c4-a3c1-4ded-8bbf-8a15dac34e70 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:30.805296 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-837a19c4-a3c1-4ded-8bbf-8a15dac34e70 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:30.812667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-837a19c4-a3c1-4ded-8bbf-8a15dac34e70 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:30.813122 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-837a19c4-a3c1-4ded-8bbf-8a15dac34e70 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:30.813885 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-837a19c4-a3c1-4ded-8bbf-8a15dac34e70 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:30.814329 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-837a19c4-a3c1-4ded-8bbf-8a15dac34e70 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:30.978846 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-837a19c4-a3c1-4ded-8bbf-8a15dac34e70 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:30.987591 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-837a19c4-a3c1-4ded-8bbf-8a15dac34e70 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1568 microversion: 2.1 time: 0.188172 Jul 04 04:30:30.988170 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 620/1210] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:30 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:32.005282 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6fb304a3-10ae-4a54-86fe-ddd89e25873f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:32.005863 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6fb304a3-10ae-4a54-86fe-ddd89e25873f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:32.013101 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6fb304a3-10ae-4a54-86fe-ddd89e25873f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:32.013556 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6fb304a3-10ae-4a54-86fe-ddd89e25873f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:32.014360 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6fb304a3-10ae-4a54-86fe-ddd89e25873f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:32.014818 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6fb304a3-10ae-4a54-86fe-ddd89e25873f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:32.034812 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:30:32.160929 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6fb304a3-10ae-4a54-86fe-ddd89e25873f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:32.173323 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6fb304a3-10ae-4a54-86fe-ddd89e25873f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1568 microversion: 2.1 time: 0.171273 Jul 04 04:30:32.174122 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 591/1211] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:32 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:33.194763 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-f63ac785-4154-4398-a3e5-45b18ea9ab9f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:33.195371 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-f63ac785-4154-4398-a3e5-45b18ea9ab9f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:33.202346 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f63ac785-4154-4398-a3e5-45b18ea9ab9f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:33.202796 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f63ac785-4154-4398-a3e5-45b18ea9ab9f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:33.203809 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f63ac785-4154-4398-a3e5-45b18ea9ab9f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:33.204242 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-f63ac785-4154-4398-a3e5-45b18ea9ab9f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:33.343857 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-f63ac785-4154-4398-a3e5-45b18ea9ab9f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:33.351982 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-f63ac785-4154-4398-a3e5-45b18ea9ab9f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1509 microversion: 2.1 time: 0.161334 Jul 04 04:30:33.352555 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 621/1212] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:33 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:33.369852 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-398936bb-b452-4fa1-9ea7-7598a2ad6dd2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:30:33.370790 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-398936bb-b452-4fa1-9ea7-7598a2ad6dd2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:33.380751 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-398936bb-b452-4fa1-9ea7-7598a2ad6dd2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:33.381393 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-398936bb-b452-4fa1-9ea7-7598a2ad6dd2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:33.382905 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-398936bb-b452-4fa1-9ea7-7598a2ad6dd2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:33.383365 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-398936bb-b452-4fa1-9ea7-7598a2ad6dd2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:33.476207 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-398936bb-b452-4fa1-9ea7-7598a2ad6dd2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "POST /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c/action" status: 202 len: 0 microversion: 2.1 time: 0.110981 Jul 04 04:30:33.476911 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 592/1213] 10.222.0.16 () {60 vars in 1277 bytes} [Mon Jul 4 04:30:33 2022] POST /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:30:33.485323 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-572f2ddc-ca01-492e-ad21-ac12004d9228 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:33.485937 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-572f2ddc-ca01-492e-ad21-ac12004d9228 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:33.492385 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-572f2ddc-ca01-492e-ad21-ac12004d9228 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:33.492917 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-572f2ddc-ca01-492e-ad21-ac12004d9228 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:33.493687 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-572f2ddc-ca01-492e-ad21-ac12004d9228 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:33.494097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-572f2ddc-ca01-492e-ad21-ac12004d9228 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:33.647770 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-572f2ddc-ca01-492e-ad21-ac12004d9228 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:33.657407 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-572f2ddc-ca01-492e-ad21-ac12004d9228 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1517 microversion: 2.1 time: 0.175303 Jul 04 04:30:33.660573 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 622/1214] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:33 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:34.675305 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-60f7a968-0717-41c0-940a-a818c2c09e7e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:34.675940 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-60f7a968-0717-41c0-940a-a818c2c09e7e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:34.682791 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60f7a968-0717-41c0-940a-a818c2c09e7e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:34.683257 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60f7a968-0717-41c0-940a-a818c2c09e7e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:34.684042 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60f7a968-0717-41c0-940a-a818c2c09e7e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:34.684473 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60f7a968-0717-41c0-940a-a818c2c09e7e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:34.830266 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-60f7a968-0717-41c0-940a-a818c2c09e7e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:34.838302 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-60f7a968-0717-41c0-940a-a818c2c09e7e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1519 microversion: 2.1 time: 0.168241 Jul 04 04:30:34.838946 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 593/1215] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:34 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:35.861419 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-6ea5a517-6880-42ae-91b6-cbb68f70b923 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:35.862047 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-6ea5a517-6880-42ae-91b6-cbb68f70b923 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:35.869072 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6ea5a517-6880-42ae-91b6-cbb68f70b923 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:35.869496 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6ea5a517-6880-42ae-91b6-cbb68f70b923 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:35.870290 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6ea5a517-6880-42ae-91b6-cbb68f70b923 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:35.870767 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-6ea5a517-6880-42ae-91b6-cbb68f70b923 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:36.014678 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-6ea5a517-6880-42ae-91b6-cbb68f70b923 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:36.023092 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-6ea5a517-6880-42ae-91b6-cbb68f70b923 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1575 microversion: 2.1 time: 0.165668 Jul 04 04:30:36.023667 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 623/1216] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:35 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:37.040407 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c9da240b-c8ba-4bd2-8117-e0106dd519fb tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:37.040957 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c9da240b-c8ba-4bd2-8117-e0106dd519fb tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:37.048122 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9da240b-c8ba-4bd2-8117-e0106dd519fb tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:37.048566 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9da240b-c8ba-4bd2-8117-e0106dd519fb tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:37.049352 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9da240b-c8ba-4bd2-8117-e0106dd519fb tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:37.049783 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9da240b-c8ba-4bd2-8117-e0106dd519fb tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:37.195021 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c9da240b-c8ba-4bd2-8117-e0106dd519fb tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:37.203324 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c9da240b-c8ba-4bd2-8117-e0106dd519fb tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1575 microversion: 2.1 time: 0.166925 Jul 04 04:30:37.203882 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 594/1217] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:37 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:38.221967 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-0cef9f9a-735f-492d-a37a-30d974608c55 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:38.222821 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-0cef9f9a-735f-492d-a37a-30d974608c55 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:38.230617 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0cef9f9a-735f-492d-a37a-30d974608c55 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:38.231096 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0cef9f9a-735f-492d-a37a-30d974608c55 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:38.231910 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0cef9f9a-735f-492d-a37a-30d974608c55 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:38.232462 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-0cef9f9a-735f-492d-a37a-30d974608c55 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:38.383026 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-0cef9f9a-735f-492d-a37a-30d974608c55 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:38.393581 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-0cef9f9a-735f-492d-a37a-30d974608c55 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1575 microversion: 2.1 time: 0.176281 Jul 04 04:30:38.394593 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 624/1218] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:38 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:39.411712 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fc857244-2aeb-4d71-8ebe-6e35f26fe95c tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:39.412308 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fc857244-2aeb-4d71-8ebe-6e35f26fe95c tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:39.419693 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc857244-2aeb-4d71-8ebe-6e35f26fe95c tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:39.420142 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc857244-2aeb-4d71-8ebe-6e35f26fe95c tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:39.421114 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc857244-2aeb-4d71-8ebe-6e35f26fe95c tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:39.421555 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc857244-2aeb-4d71-8ebe-6e35f26fe95c tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:39.565571 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fc857244-2aeb-4d71-8ebe-6e35f26fe95c tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:39.573721 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fc857244-2aeb-4d71-8ebe-6e35f26fe95c tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1575 microversion: 2.1 time: 0.166199 Jul 04 04:30:39.575948 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 595/1219] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:39 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:40.271102 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-bb6aa118-38ac-4c7d-b87c-541951999035 req-13e1651b-db03-44a7-9c1b-6879c93968b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0877b0b-09e7-4cfc-87a7-7c95da81096c", "name": "network-vif-unplugged", "status": "completed", "tag": "bdb14aee-0130-4a98-a8dd-8200f34b2261"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:30:40.281749 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-bb6aa118-38ac-4c7d-b87c-541951999035 req-13e1651b-db03-44a7-9c1b-6879c93968b4 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:40.282333 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-bb6aa118-38ac-4c7d-b87c-541951999035 req-13e1651b-db03-44a7-9c1b-6879c93968b4 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:40.296005 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-bb6aa118-38ac-4c7d-b87c-541951999035 req-13e1651b-db03-44a7-9c1b-6879c93968b4 service nova] Creating event network-vif-unplugged:bdb14aee-0130-4a98-a8dd-8200f34b2261 for instance f0877b0b-09e7-4cfc-87a7-7c95da81096c on hv-cinder-74216 Jul 04 04:30:40.303274 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-bb6aa118-38ac-4c7d-b87c-541951999035 req-13e1651b-db03-44a7-9c1b-6879c93968b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035883 Jul 04 04:30:40.304391 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 625/1220] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:30:40.592691 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-019a33a7-4173-4fd5-8e12-0a4c212b4dd2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:40.593988 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-019a33a7-4173-4fd5-8e12-0a4c212b4dd2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:40.601206 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-019a33a7-4173-4fd5-8e12-0a4c212b4dd2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:40.601746 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-019a33a7-4173-4fd5-8e12-0a4c212b4dd2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:40.602690 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-019a33a7-4173-4fd5-8e12-0a4c212b4dd2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:40.603144 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-019a33a7-4173-4fd5-8e12-0a4c212b4dd2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:40.759430 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-019a33a7-4173-4fd5-8e12-0a4c212b4dd2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:40.767424 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-019a33a7-4173-4fd5-8e12-0a4c212b4dd2 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1575 microversion: 2.1 time: 0.178751 Jul 04 04:30:40.768330 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 596/1221] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:40 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:41.786537 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-8b00e402-f3b6-4ecc-a0cc-d173fd9c01c7 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:41.787223 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-8b00e402-f3b6-4ecc-a0cc-d173fd9c01c7 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:41.794711 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8b00e402-f3b6-4ecc-a0cc-d173fd9c01c7 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:41.795143 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8b00e402-f3b6-4ecc-a0cc-d173fd9c01c7 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:41.795945 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8b00e402-f3b6-4ecc-a0cc-d173fd9c01c7 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:41.796375 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-8b00e402-f3b6-4ecc-a0cc-d173fd9c01c7 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:41.944422 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-8b00e402-f3b6-4ecc-a0cc-d173fd9c01c7 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:41.951480 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=100 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:30:41.955708 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-8b00e402-f3b6-4ecc-a0cc-d173fd9c01c7 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1575 microversion: 2.1 time: 0.173649 Jul 04 04:30:41.956320 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 626/1222] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:41 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:42.973411 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1643ff01-819f-4f61-966a-f8a0a82b03ff tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:42.973954 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1643ff01-819f-4f61-966a-f8a0a82b03ff tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:42.981263 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1643ff01-819f-4f61-966a-f8a0a82b03ff tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:42.981708 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1643ff01-819f-4f61-966a-f8a0a82b03ff tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:42.982593 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1643ff01-819f-4f61-966a-f8a0a82b03ff tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:42.983319 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1643ff01-819f-4f61-966a-f8a0a82b03ff tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:43.135942 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1643ff01-819f-4f61-966a-f8a0a82b03ff tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:43.144125 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1643ff01-819f-4f61-966a-f8a0a82b03ff tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1575 microversion: 2.1 time: 0.174714 Jul 04 04:30:43.144718 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 597/1223] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:42 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:44.161623 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-34c6df63-6569-4491-90de-590da28021be tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:44.162206 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-34c6df63-6569-4491-90de-590da28021be tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:44.169562 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-34c6df63-6569-4491-90de-590da28021be tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:44.170003 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-34c6df63-6569-4491-90de-590da28021be tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:44.170794 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-34c6df63-6569-4491-90de-590da28021be tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:44.171223 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-34c6df63-6569-4491-90de-590da28021be tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:44.303021 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-34c6df63-6569-4491-90de-590da28021be tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:44.310707 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-34c6df63-6569-4491-90de-590da28021be tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1575 microversion: 2.1 time: 0.153396 Jul 04 04:30:44.311276 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 627/1224] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:44 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:45.328130 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-18bd1e4c-8bc8-4a45-871a-4efca4e54434 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:45.328731 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-18bd1e4c-8bc8-4a45-871a-4efca4e54434 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:45.338420 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18bd1e4c-8bc8-4a45-871a-4efca4e54434 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:45.338854 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18bd1e4c-8bc8-4a45-871a-4efca4e54434 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:45.339632 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18bd1e4c-8bc8-4a45-871a-4efca4e54434 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:45.340066 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18bd1e4c-8bc8-4a45-871a-4efca4e54434 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:45.475057 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-18bd1e4c-8bc8-4a45-871a-4efca4e54434 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:45.483284 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-18bd1e4c-8bc8-4a45-871a-4efca4e54434 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1575 microversion: 2.1 time: 0.159103 Jul 04 04:30:45.484118 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 598/1225] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:45 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:46.502766 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-d41234ba-8903-4607-9212-e834aac9a5c9 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:46.503449 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-d41234ba-8903-4607-9212-e834aac9a5c9 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:46.506221 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=39 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:30:46.513564 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d41234ba-8903-4607-9212-e834aac9a5c9 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:46.514092 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d41234ba-8903-4607-9212-e834aac9a5c9 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:46.515052 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d41234ba-8903-4607-9212-e834aac9a5c9 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:46.515604 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-d41234ba-8903-4607-9212-e834aac9a5c9 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:46.656548 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-d41234ba-8903-4607-9212-e834aac9a5c9 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:46.668451 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-d41234ba-8903-4607-9212-e834aac9a5c9 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1575 microversion: 2.1 time: 0.170265 Jul 04 04:30:46.669386 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 628/1226] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:46 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:47.695172 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fdfa6dbc-379b-4159-8ce1-dad592a14de5 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:47.696036 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fdfa6dbc-379b-4159-8ce1-dad592a14de5 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:47.699132 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:30:47.705106 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fdfa6dbc-379b-4159-8ce1-dad592a14de5 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:47.705552 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fdfa6dbc-379b-4159-8ce1-dad592a14de5 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:47.706620 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fdfa6dbc-379b-4159-8ce1-dad592a14de5 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:47.707060 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fdfa6dbc-379b-4159-8ce1-dad592a14de5 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:47.841852 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fdfa6dbc-379b-4159-8ce1-dad592a14de5 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:47.849530 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fdfa6dbc-379b-4159-8ce1-dad592a14de5 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1575 microversion: 2.1 time: 0.160918 Jul 04 04:30:47.850096 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 599/1227] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:47 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:48.869673 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-72d4436c-a865-464c-ba3f-3fe89203ed1f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:48.870734 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-72d4436c-a865-464c-ba3f-3fe89203ed1f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:48.879042 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-72d4436c-a865-464c-ba3f-3fe89203ed1f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:48.879724 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-72d4436c-a865-464c-ba3f-3fe89203ed1f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:48.881142 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-72d4436c-a865-464c-ba3f-3fe89203ed1f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:48.881688 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-72d4436c-a865-464c-ba3f-3fe89203ed1f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:49.037504 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-72d4436c-a865-464c-ba3f-3fe89203ed1f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:49.046897 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-72d4436c-a865-464c-ba3f-3fe89203ed1f tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1575 microversion: 2.1 time: 0.183255 Jul 04 04:30:49.047478 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 629/1228] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:48 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1575 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:50.071369 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-012be66f-bd37-46e1-94f3-4cb9d664d5b7 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:50.072382 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-012be66f-bd37-46e1-94f3-4cb9d664d5b7 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:50.079968 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-012be66f-bd37-46e1-94f3-4cb9d664d5b7 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:50.080416 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-012be66f-bd37-46e1-94f3-4cb9d664d5b7 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:50.081190 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-012be66f-bd37-46e1-94f3-4cb9d664d5b7 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:50.081605 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-012be66f-bd37-46e1-94f3-4cb9d664d5b7 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:50.238886 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-012be66f-bd37-46e1-94f3-4cb9d664d5b7 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:50.247289 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-012be66f-bd37-46e1-94f3-4cb9d664d5b7 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1575 microversion: 2.1 time: 0.182376 Jul 04 04:30:50.247904 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 600/1229] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:50 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:51.272528 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c9bc207a-bfbb-45ce-96d6-0f7c4b5e875b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:51.273441 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c9bc207a-bfbb-45ce-96d6-0f7c4b5e875b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:51.284295 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c9bc207a-bfbb-45ce-96d6-0f7c4b5e875b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:51.285029 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c9bc207a-bfbb-45ce-96d6-0f7c4b5e875b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:51.286307 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c9bc207a-bfbb-45ce-96d6-0f7c4b5e875b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:51.287068 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c9bc207a-bfbb-45ce-96d6-0f7c4b5e875b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:51.433810 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c9bc207a-bfbb-45ce-96d6-0f7c4b5e875b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:51.441725 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c9bc207a-bfbb-45ce-96d6-0f7c4b5e875b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1575 microversion: 2.1 time: 0.175887 Jul 04 04:30:51.442258 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 630/1230] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:51 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:52.459706 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1b6b0036-d779-42cb-b7a9-243d29ee2919 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:52.460308 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1b6b0036-d779-42cb-b7a9-243d29ee2919 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:52.467090 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b6b0036-d779-42cb-b7a9-243d29ee2919 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:52.467542 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b6b0036-d779-42cb-b7a9-243d29ee2919 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:52.468311 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b6b0036-d779-42cb-b7a9-243d29ee2919 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:52.468937 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b6b0036-d779-42cb-b7a9-243d29ee2919 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:52.607607 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1b6b0036-d779-42cb-b7a9-243d29ee2919 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:52.615598 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1b6b0036-d779-42cb-b7a9-243d29ee2919 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1575 microversion: 2.1 time: 0.160186 Jul 04 04:30:52.616162 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 601/1231] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:52 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:53.635727 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-68be15f4-f476-45d5-ade5-000cbc9eef93 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:53.636354 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-68be15f4-f476-45d5-ade5-000cbc9eef93 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:53.643153 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-68be15f4-f476-45d5-ade5-000cbc9eef93 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:53.643784 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-68be15f4-f476-45d5-ade5-000cbc9eef93 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:53.644712 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-68be15f4-f476-45d5-ade5-000cbc9eef93 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:53.645450 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-68be15f4-f476-45d5-ade5-000cbc9eef93 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:53.787530 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-68be15f4-f476-45d5-ade5-000cbc9eef93 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:53.795505 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-68be15f4-f476-45d5-ade5-000cbc9eef93 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1575 microversion: 2.1 time: 0.165996 Jul 04 04:30:53.796087 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 631/1232] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:53 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:54.389154 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-223bb0b9-2bec-4f17-ae0a-aa579f4cb9c1 req-fbf4e5bb-b542-4e11-bfd2-0684e7be335b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0877b0b-09e7-4cfc-87a7-7c95da81096c", "name": "network-vif-plugged", "status": "completed", "tag": "bdb14aee-0130-4a98-a8dd-8200f34b2261"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:30:54.410768 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-223bb0b9-2bec-4f17-ae0a-aa579f4cb9c1 req-fbf4e5bb-b542-4e11-bfd2-0684e7be335b service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:54.411239 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-223bb0b9-2bec-4f17-ae0a-aa579f4cb9c1 req-fbf4e5bb-b542-4e11-bfd2-0684e7be335b service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:54.423640 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-223bb0b9-2bec-4f17-ae0a-aa579f4cb9c1 req-fbf4e5bb-b542-4e11-bfd2-0684e7be335b service nova] Creating event network-vif-plugged:bdb14aee-0130-4a98-a8dd-8200f34b2261 for instance f0877b0b-09e7-4cfc-87a7-7c95da81096c on hv-cinder-74216 Jul 04 04:30:54.429897 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-223bb0b9-2bec-4f17-ae0a-aa579f4cb9c1 req-fbf4e5bb-b542-4e11-bfd2-0684e7be335b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044161 Jul 04 04:30:54.430662 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 602/1233] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 04:30:54.815896 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-b3df2d64-0b26-4f29-94fe-dfa35cc6a3a6 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:54.816708 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-b3df2d64-0b26-4f29-94fe-dfa35cc6a3a6 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:54.826305 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b3df2d64-0b26-4f29-94fe-dfa35cc6a3a6 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:54.827019 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b3df2d64-0b26-4f29-94fe-dfa35cc6a3a6 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:54.828097 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b3df2d64-0b26-4f29-94fe-dfa35cc6a3a6 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:54.828710 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-b3df2d64-0b26-4f29-94fe-dfa35cc6a3a6 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:54.971600 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-b3df2d64-0b26-4f29-94fe-dfa35cc6a3a6 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:54.980033 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-b3df2d64-0b26-4f29-94fe-dfa35cc6a3a6 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1575 microversion: 2.1 time: 0.169917 Jul 04 04:30:54.980877 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 632/1234] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:54 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:55.998089 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-743886cf-fc98-49da-89f5-055c6cf86572 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:55.998825 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-743886cf-fc98-49da-89f5-055c6cf86572 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:56.005709 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-743886cf-fc98-49da-89f5-055c6cf86572 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:56.006147 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-743886cf-fc98-49da-89f5-055c6cf86572 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:56.007252 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-743886cf-fc98-49da-89f5-055c6cf86572 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:56.007677 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-743886cf-fc98-49da-89f5-055c6cf86572 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:56.151515 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-743886cf-fc98-49da-89f5-055c6cf86572 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:56.159742 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-743886cf-fc98-49da-89f5-055c6cf86572 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1575 microversion: 2.1 time: 0.166134 Jul 04 04:30:56.160317 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 603/1235] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:55 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:30:57.177824 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-52bdea67-d2be-4fcd-8de9-13597bb16416 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:30:57.178408 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-52bdea67-d2be-4fcd-8de9-13597bb16416 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:30:57.185242 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-52bdea67-d2be-4fcd-8de9-13597bb16416 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:57.185692 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-52bdea67-d2be-4fcd-8de9-13597bb16416 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:57.186475 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-52bdea67-d2be-4fcd-8de9-13597bb16416 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:30:57.186925 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-52bdea67-d2be-4fcd-8de9-13597bb16416 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:30:57.325884 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-52bdea67-d2be-4fcd-8de9-13597bb16416 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:30:57.334699 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-52bdea67-d2be-4fcd-8de9-13597bb16416 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1562 microversion: 2.1 time: 0.160856 Jul 04 04:30:57.335281 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 633/1236] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:30:57 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:32:27.079485 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d5b8589c-9799-4f0a-aadd-4f88722cf989 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:32:27.086916 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d5b8589c-9799-4f0a-aadd-4f88722cf989 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:32:27.087294 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_api:SELECT=11 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:32:27.091523 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ed6e84c0-a7c1-4a66-a087-1fb82f0e3b81] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 04 04:32:27.092647 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG dbcounter [-] [117875] Writing DB stats nova_cell1:SELECT=42 {{(pid=117875) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:32:27.095749 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=9 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:32:27.098082 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:32:27.106078 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5b8589c-9799-4f0a-aadd-4f88722cf989 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:32:27.106869 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5b8589c-9799-4f0a-aadd-4f88722cf989 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:32:27.108091 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5b8589c-9799-4f0a-aadd-4f88722cf989 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:32:27.108816 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d5b8589c-9799-4f0a-aadd-4f88722cf989 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:32:27.141113 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d5b8589c-9799-4f0a-aadd-4f88722cf989 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 04:32:27.227695 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-af8fb835-1496-4857-8254-27b9837efe3a req-11ac58cc-05cd-4759-80b0-e5a501bcf4fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0877b0b-09e7-4cfc-87a7-7c95da81096c", "tag": "bdb14aee-0130-4a98-a8dd-8200f34b2261"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:32:27.236782 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-af8fb835-1496-4857-8254-27b9837efe3a req-11ac58cc-05cd-4759-80b0-e5a501bcf4fd service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:32:27.237222 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-af8fb835-1496-4857-8254-27b9837efe3a req-11ac58cc-05cd-4759-80b0-e5a501bcf4fd service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:32:27.238774 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d5b8589c-9799-4f0a-aadd-4f88722cf989 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 204 len: 0 microversion: 2.1 time: 0.163180 Jul 04 04:32:27.239886 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 604/1237] 10.222.0.16 () {58 vars in 1238 bytes} [Mon Jul 4 04:32:27 2022] DELETE /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 04:32:27.248495 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-99d7a724-b957-4f2b-b31c-b8ee4338ef4e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:32:27.249194 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-99d7a724-b957-4f2b-b31c-b8ee4338ef4e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:32:27.250315 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-af8fb835-1496-4857-8254-27b9837efe3a req-11ac58cc-05cd-4759-80b0-e5a501bcf4fd service nova] Creating event network-changed:bdb14aee-0130-4a98-a8dd-8200f34b2261 for instance f0877b0b-09e7-4cfc-87a7-7c95da81096c on hv-cinder-74216 Jul 04 04:32:27.256290 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-af8fb835-1496-4857-8254-27b9837efe3a req-11ac58cc-05cd-4759-80b0-e5a501bcf4fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174735 Jul 04 04:32:27.256491 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99d7a724-b957-4f2b-b31c-b8ee4338ef4e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:32:27.256808 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99d7a724-b957-4f2b-b31c-b8ee4338ef4e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:32:27.257204 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 634/1238] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:32:27.257605 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99d7a724-b957-4f2b-b31c-b8ee4338ef4e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:32:27.258018 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99d7a724-b957-4f2b-b31c-b8ee4338ef4e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:32:27.390541 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-99d7a724-b957-4f2b-b31c-b8ee4338ef4e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:32:27.398839 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-99d7a724-b957-4f2b-b31c-b8ee4338ef4e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1568 microversion: 2.1 time: 0.154504 Jul 04 04:32:27.399422 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 605/1239] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:32:27 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:32:28.418166 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-c9ce0e4e-f72e-4527-bc74-9eb2a7d94ab1 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:32:28.418888 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-c9ce0e4e-f72e-4527-bc74-9eb2a7d94ab1 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:32:28.425804 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c9ce0e4e-f72e-4527-bc74-9eb2a7d94ab1 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:32:28.426260 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c9ce0e4e-f72e-4527-bc74-9eb2a7d94ab1 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:32:28.427061 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c9ce0e4e-f72e-4527-bc74-9eb2a7d94ab1 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:32:28.427494 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-c9ce0e4e-f72e-4527-bc74-9eb2a7d94ab1 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:32:28.570322 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.policy [None req-c9ce0e4e-f72e-4527-bc74-9eb2a7d94ab1 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117875) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:32:28.578242 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-c9ce0e4e-f72e-4527-bc74-9eb2a7d94ab1 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1568 microversion: 2.1 time: 0.164860 Jul 04 04:32:28.578867 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 635/1240] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:32:28 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:32:29.596828 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-36410523-e97d-46c8-8399-16466fd4bd62 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:32:29.598353 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-36410523-e97d-46c8-8399-16466fd4bd62 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:32:29.606028 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36410523-e97d-46c8-8399-16466fd4bd62 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:32:29.606501 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36410523-e97d-46c8-8399-16466fd4bd62 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:32:29.607259 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36410523-e97d-46c8-8399-16466fd4bd62 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:32:29.607696 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-36410523-e97d-46c8-8399-16466fd4bd62 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:32:29.623529 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] [ed6e84c0-a7c1-4a66-a087-1fb82f0e3b81] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33756. Jul 04 04:32:29.810153 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-36410523-e97d-46c8-8399-16466fd4bd62 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:32:29.819233 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-36410523-e97d-46c8-8399-16466fd4bd62 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1449 microversion: 2.1 time: 0.226803 Jul 04 04:32:29.819900 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 606/1241] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:32:29 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1449 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:32:30.037425 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [req-6c0a4773-1e4a-4f97-8394-673ac92ce5dc req-02f41d15-5890-4c8c-a3d2-8bd5325217d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0877b0b-09e7-4cfc-87a7-7c95da81096c", "name": "network-vif-deleted", "tag": "bdb14aee-0130-4a98-a8dd-8200f34b2261"}]} {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 04:32:30.045600 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-6c0a4773-1e4a-4f97-8394-673ac92ce5dc req-02f41d15-5890-4c8c-a3d2-8bd5325217d9 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:32:30.046043 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [req-6c0a4773-1e4a-4f97-8394-673ac92ce5dc req-02f41d15-5890-4c8c-a3d2-8bd5325217d9 service nova] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:32:30.057987 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.compute.server_external_events [req-6c0a4773-1e4a-4f97-8394-673ac92ce5dc req-02f41d15-5890-4c8c-a3d2-8bd5325217d9 service nova] Creating event network-vif-deleted:bdb14aee-0130-4a98-a8dd-8200f34b2261 for instance f0877b0b-09e7-4cfc-87a7-7c95da81096c on hv-cinder-74216 Jul 04 04:32:30.062986 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [req-6c0a4773-1e4a-4f97-8394-673ac92ce5dc req-02f41d15-5890-4c8c-a3d2-8bd5325217d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087688 Jul 04 04:32:30.063563 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 636/1242] 10.222.0.16 () {64 vars in 1317 bytes} [Mon Jul 4 04:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 04:32:30.836841 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a0620832-1df7-415c-873c-cb3ade5d647e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:32:30.837430 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a0620832-1df7-415c-873c-cb3ade5d647e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:32:30.845015 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0620832-1df7-415c-873c-cb3ade5d647e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:32:30.845525 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0620832-1df7-415c-873c-cb3ade5d647e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:32:30.846293 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0620832-1df7-415c-873c-cb3ade5d647e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:32:30.846760 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0620832-1df7-415c-873c-cb3ade5d647e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:32:30.881693 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0620832-1df7-415c-873c-cb3ade5d647e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:32:30.882048 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0620832-1df7-415c-873c-cb3ade5d647e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:32:30.882534 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-a0620832-1df7-415c-873c-cb3ade5d647e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lazy-loading 'fault' on Instance uuid f0877b0b-09e7-4cfc-87a7-7c95da81096c {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 04:32:30.927638 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a0620832-1df7-415c-873c-cb3ade5d647e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8158ebeedf7438b9e3306186c1898cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bb5a1e0698348739f44376f82c933ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 04:32:30.934866 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a0620832-1df7-415c-873c-cb3ade5d647e tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 200 len: 1178 microversion: 2.1 time: 0.102126 Jul 04 04:32:30.935594 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 607/1243] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:32:30 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 1178 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 04:32:31.955395 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-848f99cd-d113-43ae-8cd2-00767c65a842 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '>' {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:32:31.956033 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.compute.api [None req-848f99cd-d113-43ae-8cd2-00767c65a842 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] [instance: f0877b0b-09e7-4cfc-87a7-7c95da81096c] Fetching instance by UUID {{(pid=117875) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 04:32:31.963256 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-848f99cd-d113-43ae-8cd2-00767c65a842 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:32:31.963692 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-848f99cd-d113-43ae-8cd2-00767c65a842 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:32:31.964451 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-848f99cd-d113-43ae-8cd2-00767c65a842 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 04:32:31.964878 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG oslo_concurrency.lockutils [None req-848f99cd-d113-43ae-8cd2-00767c65a842 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Lock "0ce0899c-f5f4-4daa-b092-f0b42011e739" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 04:32:31.978939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.wsgi [None req-848f99cd-d113-43ae-8cd2-00767c65a842 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] HTTP exception thrown: Instance f0877b0b-09e7-4cfc-87a7-7c95da81096c could not be found. Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-848f99cd-d113-43ae-8cd2-00767c65a842 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Request method failure captured: Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: request: GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c HTTP/1.1 Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept: application/json Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Accept-Encoding: identity Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Connection: close Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Length: 0 Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Content-Type: application/json Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Host: 10.222.0.16 Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Openstack-System-Scope: None Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: User-Agent: python-urllib3/1.26.9 Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Auth-Token: gAAAAABiwmwKzZfJJHdVnmCcQ04u8wiO948n22tfOKoIdYpb_c7Fiyx41OlL16kpDLQ6t_n3gFXe0TV7vmmABX0-U5U1OWDVGERs6G0DSxxib3y98wUPwArmHqLAfsj9rjN1_o6WhXwf8BffKWsT5l9UGXCA39AlAzDJs2LLS2Y9nA3q00dSd3o Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Id: None Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Domain-Name: None Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Identity-Status: Confirmed Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Is-Admin-Project: True Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Id: default Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Domain-Name: Default Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Id: 4bb5a1e0698348739f44376f82c933ad Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Project-Name: tempest-TestShelveInstance-1675663107 Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Role: member,reader Jul 04 04:32:31.980628 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Roles: member,reader Jul 04 04:32:31.982420 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4bb5a1e0698348739f44376f82c933ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4bb5a1e0698348739f44376f82c933ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4bb5a1e0698348739f44376f82c933ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4bb5a1e0698348739f44376f82c933ad", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Jul 04 04:32:31.982420 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant: tempest-TestShelveInstance-1675663107 Jul 04 04:32:31.982420 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Id: 4bb5a1e0698348739f44376f82c933ad Jul 04 04:32:31.982420 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-Tenant-Name: tempest-TestShelveInstance-1675663107 Jul 04 04:32:31.982420 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User: tempest-TestShelveInstance-1675663107-project Jul 04 04:32:31.982420 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Id: default Jul 04 04:32:31.982420 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Domain-Name: Default Jul 04 04:32:31.982420 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Id: b8158ebeedf7438b9e3306186c1898cd Jul 04 04:32:31.982420 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: X-User-Name: tempest-TestShelveInstance-1675663107-project Jul 04 04:32:31.982420 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: method: > Jul 04 04:32:31.982420 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: exception: Instance f0877b0b-09e7-4cfc-87a7-7c95da81096c could not be found. Jul 04 04:32:31.982420 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: action_args: {'id': 'f0877b0b-09e7-4cfc-87a7-7c95da81096c'} Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: {{(pid=117875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0877b0b-09e7-4cfc-87a7-7c95da81096c could not be found. Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 04:32:31.983918 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 04:32:31.985610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 04:32:31.985610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 04:32:31.985610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 04:32:31.985610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 04:32:31.985610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 04:32:31.985610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 04:32:31.985610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 04:32:31.985610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0877b0b-09e7-4cfc-87a7-7c95da81096c could not be found. Jul 04 04:32:31.985610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:32:31.985610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 04:32:31.985610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:32:31.985610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 04:32:31.985610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 04:32:31.985610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 04:32:31.985610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 04:32:31.985610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 04:32:31.985610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0877b0b-09e7-4cfc-87a7-7c95da81096c could not be found. Jul 04 04:32:31.985610 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: ERROR nova.api.openstack.wsgi Jul 04 04:32:31.987939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: DEBUG nova.api.openstack.wsgi [None req-848f99cd-d113-43ae-8cd2-00767c65a842 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Returning 404 to user: Instance f0877b0b-09e7-4cfc-87a7-7c95da81096c could not be found. {{(pid=117875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 04:32:31.987939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO nova.api.openstack.requestlog [None req-848f99cd-d113-43ae-8cd2-00767c65a842 tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c" status: 404 len: 111 microversion: 2.1 time: 0.031846 Jul 04 04:32:31.987939 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: [pid: 117875|app: 0|req: 637/1244] 10.222.0.16 () {58 vars in 1235 bytes} [Mon Jul 4 04:32:31 2022] GET /compute/v2.1/servers/f0877b0b-09e7-4cfc-87a7-7c95da81096c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 04:32:32.147742 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f60a41af-4065-46e0-9cc6-9b0d46d0e48b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] Calling method '.version_select at 0x7f50c1b3fd30>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 04:32:32.169804 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f60a41af-4065-46e0-9cc6-9b0d46d0e48b tempest-TestShelveInstance-1675663107 tempest-TestShelveInstance-1675663107-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-655930833" status: 202 len: 0 microversion: 2.1 time: 0.025707 Jul 04 04:32:32.170109 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 608/1245] 10.222.0.16 () {58 vars in 1250 bytes} [Mon Jul 4 04:32:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-655930833 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 04:33:00.641453 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 04:33:00.642002 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Mon Jul 4 04:33:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 04:33:03.303812 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 04:33:03.304588 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Mon Jul 4 04:33:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 04:34:47.435966 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 04:34:47.436817 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Mon Jul 4 04:34:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 04:35:11.856352 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 04:35:11.857466 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Mon Jul 4 04:35:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 04:35:13.064462 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 04:35:13.065390 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Mon Jul 4 04:35:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 04:36:20.651053 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 04:36:20.651575 dv-cinder-742162-5-iscsi devstack@n-api.service[117875]: Mon Jul 4 04:36:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 04:36:23.317375 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 04:36:23.318181 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Mon Jul 4 04:36:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 04:38:03.403025 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 04:38:03.403646 dv-cinder-742162-5-iscsi devstack@n-api.service[117877]: Mon Jul 4 04:38:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!